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ABSTRACT 

Presented in the sourcebook for the teacher rdudci,^or 
is the Four-D model (define, design, dev^Jlop, and disseminate) to be 
used for developing instructional Bateci^ils for training teachers of 
exceptional children. Listed at the b^giii;|iifig of chapters are 
instructional objectives; included wh^iQ appropriate are guidelines, 
checklists, and flov charts. Given fot use of the book are 
instructions such as reading chapter 1 for an over/lev, choosing a 
topic, and checking chapter objectives for ess^ntialnesis to task 
accoBpllshient. Noted in the Introdiictlon are the transition in 
special education that requires teachers to demonstrate competency, 
the efficacy and validity of special training programs, and the role 
of the Four-D model. The stage categorized as "define" is described 
to be analytical and to Involve five steps: front-end analysis 
(problems facing the teacher trainer) , learner analysis, task 
analysis, concept a;ialysls, and the specifying of Instructional 
objectives. The next stage is seen to Involve the design of prototype 
instructional material and to comprise four steps: con^structlon of 
criterion referenced tests, media selection, format selection, and 
initial design for presentation of instruction through media such as 
tests, textbooks, audlotutorial' models, and computer assisted 
Instruction. The developmental stage Is said to comprise modification 
of the prototype material through expert appraisal and developmental 
testing. Described ^or the final stage (disseminate) are summafcive 
evaluation, final packaging activities such as securing copyright 
releases, and diffusion. (HC) 
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Foreword 



As its name implies, this book is a source of ideas 
and procedures for the development and dis- 
semination cf instructional materials for teacher 
preparation programs. Although it focuses on 
needs in the field of special education, this work 
can be used productively in other fields that lack 
sufficient or adequate instruclionri! tools. The 
authors have brought together and graphically 
systematized a number of theoretical constructs and 
practical skills. Step by step, they have taken th^ 
reader from the determination of the need for new 
instructional materials, through the processes of 
ci eating and evaluating modules of instruction, 
to the mass production and distribution of the 
finished module. The purpose of the Sourcebook 
is to help the leacher educator use his hard-won 
expertise to produce instructional modules which 
can be shared with colleagues for the improvement 
of the field. The Sourcebook may well be the first 
resource of its kind in any area of education. 

The emphasis on the dissemination of productive 
ideas was not included idly. It is a partial response 
to the paucity uf processes in education for sharing 
ideas and procedures. Over the past two decade?, 
many universities and other educational agencies 
have had substantial federal support for projects 
which, it was hoped, would reach a highly visible 
and exemplary state and produce "ripple eff^jts*' 
in other service centers, both near and far. Un- 
foitun.itely, many programs, although highly in- 
novative and rewarding, culminated in poorly edited, 
iargely unread **final reports,'* or in not-quite- 
finished audio-visual or graphic materials, which 
CO ^Id only be used their producers. Although 
d^scmination was an early goal for most of the 
projects, widespread sharing never seemed to 
materialize. Persons who have gone searching for 
•'modules" or even minor products from handsomely 



supported projects almost uniformly netted nothing 
that they could use. 

The failure to share the results of developmental 
work is particularly disastrous in relatively small 
fields such as special education. The absence of 
a mass audience does not encourage commercial 
initiative and, consequently, only a thin trickle 
of materials is produced for the market. Since units 
preparing special education personnel tend to be 
small, their resources tend to be limited. Further- 
more, the resources that do exist in special edu- 
cation are unevenly distributed. As a result, some 
colleges have been able to afford lavish instructional 
materials while other colleges have struggled to 
maintain quality teaching with minimal tools. One 
of the reasons that resources and materials for 
teacher education have not been shared in the past 
is that colleges and universities were virtually 
forced to compete for federal funding. Thus, ideas 
were hoarded for grant possibilities rather than 
shared for instructional improvement. 

Happily, this situation is changing. The federal 
government is increasingly stressing the co- 
ordination of plans among training centers and 
state agencies to meet carefully documented needs. 
Jn addition, teacher education in genera) is moving 
toward the explication of specific goals and a re- 
cognition that, for accreditation purposes, out- 
comes are more important than processes. As a 
result, thft demand is growing for teaching modules 
that correspond to specific objectives in teacher 
education. Just as important, perhaps, is the move 
by the Office of Education to bloc training grants 
which may accelerate the improvemeiU of teacher 
education. 

Another obstacle in times past has been the lack 
of systems for recognizing and reinforcing good 
and generous performances in teacher education. 
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Research professors have had clear access to high- 
status channels for the dissemination of the pro- 
ducts of research, mostly through peer-juried 
research journals and monographs. No comparable 
channels exist for teacher educators. Research 
publications have been given much weight 
documenting faculty performance, which has led 
to individual promotions and other rewards. On 
the other hand» outstanding performances In teacher 
education have been difficult to document and have 
been given only cursory recognition. Obviously, 
some system for the dissemination of training 
materials is needed if excellent teaching abilities 
and innovations are to be given their due as a 
legitimate basis for professional rewards. 

Fortunately, a new course Is underway which may 
resolve some of the past problems and, at the same 
time, lead to more effective teacher preparation 
in the field of special <xJucaiion. As part of its 
mandate from the National Center for the Improve- 
ment of Educational Systems, U. S. Office of 
Education, the Leadership Training Institute/ 
Special Education has initiated the publication of 
resource material (Reynolds* Davis, 1971, Reyn- 
olds, 1971) lately in cooperation with the Council 
for Exceptional Children (Deno» 1973). Other 
dissemination activities of CEC have been centered 
in its Teacher Education Division (TED). TED 
leaders, starting with Richard 5^hofer, William 
Carriker, and Herbert Prehm, saw their plans come 
to fruition in April 1973 when TED officially 
adopted policies on» and set in motion, a program 
for the dissemination of instruction:^ <noduIes and 
materials in the field of teacher preparation. 

The Sourcebook is the first of whal» I hope, will 
be a long series of instructional materials shared 
among colleges, universities, and other training 
centers for spe<:ial education personnel. Additional 

O 



materials are already in the planning stage and, 
thus, it may not be amiss to celebrate a new spirit 
of mutual support as well as 9 new surge in quality 
in our field. This form of "shariug," it is hoped> 
will add further strength to the Teacher Education 
Division of CEC and lead to other activities of 
equal importance. 

It is most fortunate that Melvyn and Dorothy 
Semmel and Sivasailam Thiagarajan were willing 
and able to bring their competencies and commit^ 
ments to this complex of activities. Their conception 
and realization of this Sourcebook are an outgrowth 
of their involvement in th^i BEH-supported Center 
for Innovation in Teachinj;, the Handicapped at 
Indiana University. 

Thiagarajan and the Semmcis have created a 
systematic guide for materials development and 
evaluation which uli of us in special ^ucation can 
build upon in constructing a dissemination system 
that eradicates the deficiencies of the past and offers 
opportunities for the future. The authors have 
exemplified the best of "sharing'* in developing 
this work; they plan to implement it with correlative 
instruction modules in the near future. 

I wish to express my appreciation to Don Davies, 
William Smith» Stewart Tinsman, Malcolm Davis, 
and Ed Moore» pasv and present staff officers of 
the National Center for the Improvement of Edu- 
cational Systems^ for giving me the opportunity to 
help bring this interesting and valuable Sourcebook 
to special educator's. 

Maynard C. Reynolds, Director 

Leadership Training InstilutejSpecial Education 

University of Minnesota 
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How to use 
the eourcebook 



The objective of this sourcebook is to assist the 
reader ii) the design, development, and dissemination 
of instructional materials for training teachers of 
exceptional children. SpectHc instructional objectives 
are listed at the beginning of each chapter. Since 
it is anticipated that the instructional development 
competencies of readers will vary considerably, the 
chapters have been organized in modular form to 
permit their use at any appropriate stage of the 
developmental process. The following steps are 
suggested for maximizing the usefulness of the 
sourcebook: 

1 . Read Chapter I for an overview of the in- 
structional development process. 

2. Put the sourcebook aside and choose a topic 
on which you would like to develop an in* 
structional material for teacher training. 

3. Check the objectives for each chapter and decide 
whether they are essential to acco.nplish the task 
you have undertaken. For example, it is extrenr^sly 
unlikely that you will need to work through 
Chapter 16, **Computer-based formats/* during 
an initial reading. 

4. Compare your competencies with the objectives 
listed for the chapter. For example, you may 
already know how to state behavioral objectives 
or construct performance test items. Skip any 
chapter for which you have the competencies 
discussed. 



5. Upon completing each chapter, apply the tech- 
niques to the design of your instructional material. 
This procedure provides an opportunity to use 
the recently acquired skill and also prepares 

you to make maximum use of the next chapter 
in your self-selected sequence. 

6. Because the major objective of the sourcebook 
is to provide a comprehensive introduction to 
the entire instructional development process, 
each chapter covers only the fundamentals of 
the various development techniques. However, 
each chapter is laced with selected references, 
most of which are practical rather than theo- 
retical. Use these references whenever necessary. 

7. Review the suggestions in Chapter 9, "Format 
selection," and choose a suitable format for your 
instructional material. Depending upon the format 
you seWt, you will need to read only one of 

the seven format chapters. 

8. At the end of stage 3, Develop, you may feel 
that the instructional development job is done. 
However, it is suggested that you go on to Stage 
4, Disseminate, to learn the essentials of con- 
eluding an instru< tional project. 

9. After you complete your first project, we hope 
you will find the sourcebook a valuable reference 
for future instructional development projects. 
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Chaptdr 1 
Introduction 



Obiect(v68 

1. Provide a rationale for instructional development 
for special education teacher training. 

2. Trace the four stages in the development of an 
instructional material and list various steps in 
each stage. 

3. Adapt the instructional development process to 
suit the Umlied support available to a teacher 
trainer on an initial small-scale project. 

4. Explain how the transfer of Instructional develop- 
ment skills to classroom instruction ultimately 
results in positive Impact on the growth of handi- 
capped children. 
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Aspects of three fields of practice in education have 
been integrated in this sourcebook. They are (a) 
instructional systems technology, (b) teacher educa- 
tion, and (c) special education. Our major objective 
Is to stimulate the use of alternative instructional 
methods in the preparation of special education per* 
sonnel through the introduction of the concepts, 
methods, and practices used by instructional de^ 
velopers. It is not our contention that the field of 
special education has unique potential for improve- 
ment through the adoption of the instructional de- 
velopment procedures outlined in this book, Rather, 
we believe that this field, like others in education, 
has a strong need to re-evaluate current methods for 
training personnel at the preservice and iaservice 
levels to assure preparation that is meaningfully re- 
lated to the education of handicapped children in 
our schools. 



Teacher training In special education 
In transition 



As in other Helds of teacher training, special edu- 
cation is undergoing signiftcant changes. In addition 
to the growing need to supply the nation with suf- 
ficient numbers of teacheis to meet the demand for 
special educational services, there is an increasing 
emphasis on improving the quality of the teacher- 
training process and pr<:xluct. Teacher preparation 
programs, like the personnel they train, are being 
held accountable for their methods through the ef- 
fects they produce; hence, the trend toward compe- 
tency-based teacher certification. We are no longer 
satisfied that the successful completion of a list of 
lecture, recitation, and practicum courses is prima 
facie evidence of a teacher^s competence in educat- 



ing excepUonal pupils. Just as significant, probably, 
Is the growing tendency among trainees to question 
the value of course offerings, the validity of the^skllls 
and knowledge expected of them by training pro- 
grams, and the competencies of their trainers. In 
many cases, student chaHenges to existing training 
programs have stimulated departmental evaluations 
of program goals and practices. Throughout the 
nation we find faculties examining current practices 
with an eye toward altering programs to effect a 
qualitative change In the education of exceptional 
children by improving the knowledge, skills, and 
attitudes of the personnel they train. 

We hope to demonstrate in the chapters of this 
sourcebook that logical, creative, and empiricaiiy 
tested alternatives can solve some of the problems 
of providing more effective training for special edii* 
cation teachers, Inherent In systematic Instructional 
development is a focus on the characteristics of the 
learner, the nature of the skills and knovJedge the 
learner must acquire, the stipulation of objectives in 
behavioral terms, and the ways in which the attain* 
ment of objectives can be measured and certified. 
The approach also requires the trainer to analyze 
and evaluate the behaviors and concepts to be taught 
in the training program. Perhaps most importantly, 
the approach directly leads to assessable alterna- 
tives to traditional methods of training teachers. The 
reader is introduced to different media and shown 
how they are relevant to the instructional process, 
and he is furnished with a variety of instructional 
formats which, if utilized, should measurably alter 
the form and practices currently found in most 
training programs* Finally, the sourcebook is con- 
cerned with the methods by which successful In- 
stnsctional innovations can be exported to and 
adopted by the larger community of teacher educa- 
tors in special education. 



The efficacy «nd validity of tralninc programs 
In tpeclal education 



It Is important to distinguish betv/een ihe effec- 
tivenei^s of a teacher preparation program and the 
validity of the attitudes, skills, and knowledge de- 
rived from the progratti; in our view, a preparation 
program is effective if one can demonstrr^te that it 
has been instrumental In generating a relatively 
permanent change in the behavior of its trainees, 
and that this change is a function of the experi- 
ences the program has provided. To meet this cri* 
terion of effectiveness, the objectives of th.* program 
must be stipulated in behavioral terms, and the ob- 
jectives must be appropriate to the entry behaviors 
of trainees* The program must describe and/or 
demonstrate the critical defining attributes of the 
training procedures so that replication can be as- 
sured. Further, the program should produce objec- 
tive evidence for trainee attainment of the objectives. 
In other words, a program is deemed effective if it 
can be demonstrated that it has met its objectives as 
a function of a set of clearly deOnable experiences. 

Program effectiveness is a necessary but not suf- 
ficient criterion for improving special education 
through the teacher's behavior. We can clearly de- 
fine our training objectives in behavioral terms and 
meet them through effective training procedures— 
but the objectives may have little or no relation to 
successful work with exceptional pupils in the 
schools. For example, a training program may focus 
on providing a trainee with all necessciry knowledge 
of the symptoms that identify a dyslexic child. How- 
ever, this knowledge is of little use if the trainee 
never learns how to teach the child to read. 

This scmrcebook does not focus on the aptness or 
utility of vhe attitudes, skills, or knowledge which 



; training programs establish as their objectives. 

;^ . Rather, it assumes an existing or evolving commit- 
ment to what Is important to transmit to trainees. 
The book may, however, offer the reader consider- 

^ able assistance in clarifying the ways programs 

might approach the difficult task of selecting training 
objectives that can be validated againsf teacher cf- 
fe<?ts with exceptional children. A primaiy concern 
. htre Is to provide tether trainers with a method- 
ology that supports the development of effective 
training programs ' 



A mod^l for Inftlructlonal ddvolopmetit 



In recent years, a nunibcr of models for instruc- 
tional development have employed the common 
steps of analysis, design, and evaluation (Twelkcr, 
Urbach, & Buck, 1972). The systems-approach 
model around which this sourcebook is organized is 
based upon these earlier models and upon actual 
field experience Jn designing, developing, evaluating, 
and disseminating teacher-training materials in spe- 
cial education. We have called our systems-appioach 
the FDur*D Model because it divides the instruc- 
tional developmeni process Into the four stages of 
Deflae, pes^n. Develop, and Disseminate (Fig. 
1 , 1 ). A brief description of each stage follows: 



Define 

fn^tructfonal requiremdnfft 

m 

Design 

Prototypical Instructional matoNal 
Dovelop 

Trainee-tested end rellabte 
Instructional material 



1 




Disseminate 

Instructional material among 
special educational teacher 
training programs 



Figure 1.1 
Fouf-D model 



ERiC 



5 



Sti«e It Deflne 

The purpose of this stage is to stipulate and de- 
fine instructional requirements. The initial phase is 
mainly analytical. Through analysis, wc prescribe 
objectives and constraints for the instructional ma- 
terials. The five steps of the stage are shown in 
Figure 1.2. 

Front-^end analysts is the study of the basic prob- 
lem facing the teacher trainer: to raise the perform- 
ance levels of special education teachers. During 
this analysis the possibilities of more elegant and 
efnclent alternatives to instruction are considered. 
Failing them» a^search for relevant instructional 
materials already in circulation is conducted. If 
neither pertinent instructional alternative^ or ma- 
terials are available, then the development of in- 
structional material is called for 

Learner analysis is the study of the target students 
—special education teacher trainees. Student char- 
acteristics relevant to the design and development 
of instruction are identified. The characteristics are 
entering competencies and background experiences; 
genera) attitude toward the instructional topic; and 
media, format, and language preferences. 

Task analysis is the id( ntifying of the main skill 
to be acquired by the teaclier trainees and analyzing 
it into a set of necessary and sufficient subskills. 
This analysis ensures comprehensive coverage of the 
task in the instructional material. 

Concept analysis is the identifying of the major 
concepts to be taught, arranging them in hierarchies, 
and breaking down individual concepts into critical 
and irrelevant attributes. This analysis helps to 
identify a rational set of examples and nonexamples 
to be portrayed in protocol development. 

Specifying instructional objectives is the convert- 
ing of the results of task and concept analyses into 



m ^ 



Figure 1.2 
Stage l.'Oet/ne 



behaviorally stated objectives. This set of objectives 
provides the basis for test constnictiort and instruc- 
tional design. Later, it is integrated into the in- 
structional materials for use by instructors and 
teacher trainees. 



stage III Design 

The purpose of this stage is to design prototype 
instructional material. This phase can begin after 
the set of behavioral objectives for the Instructional 
material has been established Selection of media and 
formats for the material and the production of an 
Initial version constitute the major aspects of the 
design stage. The four steps in this stage are shown 
in Figure 1.3. 

Consttiietlng criterion-referenced te$t& is the step 
bridging Stage 1, Define, and the Design process. 
Criterion-rtferenced tests convert behavioral objec- 
tives into an outline for the inslructiortal material 

MedU selection is the selection of appropriate 
media for the presentation of the instructional con- 
tent. This process Involves matching the task and 
concept analyses, target-trainee characteristics, 
production resources, and dissemination plans with 
various attributes of different media. Final selection 
identifies the most appropriate medium or com- 
bination of media for use. 

Format selection is closely related to media selec- 
tion. Later in this sourcebook^ 21 different formats 
are identified which are suitable for designing in- 
structional materials for teacher training. The selec- 
tion of the most appropriate format depends upon 
a number of factors which are discussed. 

Initial design is the presenting of the essential 
Instruction through appropriate media and in a 
suitable sequence, (t also involves structuring vari- 
ous learning activities such as reading a text, inter^ 
viewing special education personnel, and practicing 
different instructional skills by teaching peers. 
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Figure 1.3 
Stage )l; Design 



St$tg0 liti Dmiop 

The purpose of Stage III Is to modify the proto- 
type instructional material Although much has 
been produced since the Define stage, the results 
must be considered an Initial version of the InstrUc* 
tional material which must be modified before it 
can become an effective final version. In the de- 
velopment stage, feedback is received through 
formative evaluation and the materials are suitably 
revised. The two steps in this stage are shown in 
Figure I A. 

Expert appraisal Is a techrlque for obtaining 
suggestions for the improvement of the material A 
number of experts are asked to evaluate the materia) 
from instructional and technical points of view, On 
the basis of their feedback^ the materia! is modified 
to make it more appropriate, effective, usable, and 
of high technical quality. 

Developmental testing involves trying out the 
material with actual trainees to locate sections for 
revision. On the basis of the respons( % reactions, 
and comments of the trainees, the material is modi- 
fied. The cycle of testing, revising, and retesting is 
repeated until the material works consistently and 
effectively. 
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Figure 1.4 
Stag6lll:Oevetop 
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Stage IVs Disseminate 

Instructional materials reach their final produc- 
tion stage when developmental testing yields con* 
sistent results and expert appraisal yields positive 
comments, the three steps in this stage are f hown 
in Figure 1,5. 

Before disseminating the materials, a summative 
evaluation is undertaken. In its validation testing 
phase, the material is used under replicable condi- 
tions to demonstrate **who learns what under what 
conditions in how much time" (Markle, 1967). The 
material is also subjected to professional examina- 
tion for objective opinions on its adequacy and 
relevance. 

The terminal stages oi final packaging^ diffusion, 
and adoption are most important although most 
frequently overlooked. A producer and a distributor 
must be selected and worked with cooperatively to 
package the material in an acceptable form. Special 
efforts are required to distribute the materials widely 
among trainers and trainees, and to encourage the 
adoption and utilization of the materials. 




Figure1,5 

Stagd IV: Dlssomlnato 
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The twher trainer an Instructional developer 
Small scale Instructional development 

Many teacher trainers do not have the time, in- 
clination, or resources to mount an ambitious in* 
structional development project involving all the 
stages described/However, the process is not 
complicated as it initially appears. As a teacher 
trainer, you have undoubtedly undertaken an in- 
formal analysis of your subject-matter area and the 
characteristics of your trainees, and probably you 
have designed a number of test items, class assign- 
ments, and reading lists. With this head siart, you 
are In a position to bypass or rapidly complete the 
Define stage. In the Design stage, several simple 
but effective formats are available for the part-time 
instructional developer. A reading list is an example 
of such a format. Its design merely requires the spe- 
cification of instrucUonal objectives and the com- 
pilation of a list of various textual materials, hand- 
outs Journal articles, and other existing documents, 
which can be duplicated in any one of several ways 
and given to the trainees. 

More comprehensive instrucitonal packages can 
be effectively developed over an extended time 
period. If, during each semester, we concentrate on 
preparing instructional materials for one small unit, 
we can gradually accumulate enough maeerlaJs to 
make the course self-contained. Working in this way, 
we do not need to assemble a special group of teacher 
trainees for the developmental testing of the ma- 
terials. During the first semester, the materials are 
tried out with the trainees already enrolled; the next 
semester is spent in revising the materials; and the 
semester after that is reserved for the validation 
testing of the materials. 



Large-scale instnietlonal development pr<kjecls 

Although the steps In the development process 
are the same for large-scale as for small-scale proj- 
ects, time and manpower requirements increase 
according to the complexity and length of instruc- 
tional content, 

The first step in large-scale development is the 
assembly of an instructional development team. 
Assuming that you are primarily a special educator, 
the first team person you will need is an Instructional 
developer or a media specialist. For certain steps of 
the developmental process, you will also need an 
evaluator, In addition, you will need a target-trainee 
population for te$ting, other teacher trainers for 
expert appraisal, graphic artists and writers for 
designing the prototype version, and a data analyst. 
In i»lanning a large-scale project, it )$ easy to over- 
lool; the first and last stages (defining instructional 
requirements; disseminating the finished product). 
As each stage plays a vital role in tho development 
process, it Is important to allot time and resources 
appropriately. 

The selected bibliography at the end of this 
chapter provides an overview of current instructional 
development literature; it should be a useful intro- 
duction to the varied aspects of instructional systems 
technology for both small- and large-scale develop- 
ment projects. 

The teacher trainer as a model 

One of the more effective means of maximizing 
learning is to provide students with appropriate 
models of the terminal behaviors that define our 
objectives. Teacher educators too frequently ignore 
this principle In the conduct of their training pro- 
grams although they support it in the abstract. 
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In working with exceptional pupils, the teachef is 
usually expected to establish his objectives carefully 
and to plan an instructional program only after he 
: has completed an analysis of the learners and the 
; organization of the content to be taught. He is ex- 
I: pected to furnish thechildren with a psychologlcat 
and physical environment that will maximize both 
intrinsic and extrinsic motivations (ot learning; to 
carefully select and develop materia^ that will match 
the learners' characteristics; and to provide appro- 
priate instructional formats for the children/Then 
he is expected to evaluate the progress of his pupils 
both formatively f»nd summatively Unfprtghaiely, 
these expectations arc not generally reinforced by 

the models which are provided by ihe teacher 
trainers. 

Another way to approach the contents of this 
sourcebook is as an outline of a training program 
model for special education teacher trainees to 
emulate. The following diagram (Fig. 1 .6) illustrates 
the hypothesized process by which the adoption of 
the iristruclibnal development model of this book 
could operate to produce meaningful effects in ex- 
ceptional pupils. 

The synthesis of Oie principles and practices of 
instructional programing with teacher training in 
special education may be expected to result in (a) 
improving the effectiveness of the training program 
in meeting its objectives, and (b) showing a positive 
impact on the growth of exceptional pupils through 
the traincij's application of the instructional model 
provided by the training program. 




Figure 1.6. 

The Sourcebook as a model for teacher 
trelnersdndfralnees. 
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W§i::.:: ^ Chapter 2 

Front-end analysis 



Obj0cUv0$ 

1. Analyze performance problems in teaching ex- 
ceptional children In terms of a discrepancy 
between the criteria and the actual behaviors 
of teachers; 

2. Identify those performance problems which 
lend themselves to instructional solutions. 

3. Locate available Instfuctional materials by 
systematically searching (or appropriate refer- 
ences. 

4. Review instructional materials by using Check- 
list 2.1, and decide whether to adopt, adapt, 

or reject. 



i; 




Succeeding chapters of this sourcebook deal with 
various stages of the Design, Development, and 
Diffusion of instructional materials. This chapter 
asks a prelimiiiary question: Is this instructional 
material really necessairy? Teacher trah^^ 
been known to overteach on occasion, a tendency 
that may extend also to the preparation of instruc- 
tional materials. We know that the development of 
such materials is a time-consuming job requ iring 
considerable resources and energy, Hence, it is 
extremely wasteful to design materials which are 
based on questionable content or v^hich simply 
replicate exis|ing materials that are acceptablf in 
both form an<} substance. 

In this chapter, therefore, we shall attempt to 
place instructional development in its proper per- 
spective as one of the various problem-solving 
techniques available to the teacher trainer in special 
education. This point of view builds on Harless*s 
(1971) concept of "front-end analysis" and Mager 
and Pipers (1970) principles of performance problem 
solving. 



When are instructional materials required? 



When does the need for an instructional material 
arise? For that matter, when does the need for in- 
struction arise in the field of teacher training? The 
answer is, when a teacher trainee*s performance is 
below a defined criterion level, 

If a trainee can already perform adequately in a 
given job, instruction in that area is totally super- 
fluous. When a discrepancy is found between the 
criterion and the actual performance, we naturally 
assume that the trainee must be taught the absent 
skill or concepts. But performance discrepancies in 



Jralnees do not necessarily indicate deficlenl skills or 
knowledge. Indeed, performance discrepancies some- 
times result from lack of motivation or from the 
presence of physical or psychological obstacles 
(Harle&ii. 1971), problems which have nothing to do 
with instruction. 

If, for example, a teacher of educable mentally 
retarded (EMR) children faih to make use of in- 
dividual slandardized reading test scores, the teacher 
trainer or supervisor may identify a performance 
discrepancy. Thus, in this example. 

Criterion perfomanee Actual performance 

Effective use of Lack of use of standard- 

test scores ized test scores 

the difference between criterion and actual per* 
formance is the performance discrepancy. It could be 
the result of one or more of the following causes: 

Environment causes. The teacher is already 
overworked. The task of obtaining standard test 
profiles is arduous and full of red tape. 

Motivaiton^l causes. The teacher might not like 
the ccmpHcated computations required to interpret 
the standardized reading test data. He may not 
believe that standardized testing is appropriate for 
his exceptional pupils and he may think it Inadvisable 
to establish an expectancy based on reading assess- 
ment. 

Lack of skills and knowledge. The teacher might 
not know how to interpret test profiles. 

In both preservice and inservice teacher-training 
situations in special education, the cause of a per- 
formance discrepancy can be traced to an interaction 
of various factors, Each type of discrepancy requires 
a different solution. Basically, a motivational prob- 
lem will need effective management of contingencies, 
and an environmental problem will lend itself to a 



re-engineering of the situation and conditions. At- 
tempting to solve these problems through Instruction 
may actually create additional problems. 

Even when instruction is strongly suggested, it is 
not always necessaiy to begin immediately to de- 
sign and develop Instructional materials. A number 
of alternative instructional approaches can be tried 
first to find the one th^t optimally suits the given 
needs and conditions. Using alr^dy available in- 
structional materials Is obviously the most efficient 
approach. Yet^ In the field of teacher training, we 
frequently "reinvent the wheel." Unfortunately, at 
this time, no comprehensive guide to Instructional 
materiab for special education teacher training is 
available and we are dependent on word-of-mouth 
information from colleagues, serendipitous selec- 
tions from publishers' catalogs, and guides and 
bibliographies geared to related educational pursuits. 

Locating inatructtonal materlala 



Many pn?mising developments are occurring in 
the field of special education today. One possible 
outcome of these developments may be the central- 
ization of information on special education teacher 
training product development in the near future. 
Until such efforts are fully realized, however, 
alternative techniques for ferreting out useful 
training materials are necessary. 

Many standard references, if used creatively, are 
good sources of information on new developments. 
The ERIC System may be queried systematically by 
using the Thesaurus of ERIC Oescrtptors (1 969) to 
obtain the specific terms that describe your interests. 
For example, if you need instructional materials for 
training teachers of physically handicapped children, 
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ChocklUt2.1 

AssoBsment of Indtruotlonal materlaU for 
Ualnlng teachers of exceptional children 



use synonyms from the Thesaurus for terms such as 
"disabled;* narrower terms such as "amputees'* or 
"orthopedlcally handicapped/' and related terms 
such as '•perceptual handicapped," ^'physical therapy/* 
"prosthesis/* and "special health problems/* Select 
the terms that come closest to identifying your area 
of interest and review the abstracts cited for them » 
as well as the citations for "teacher education/' Com 
puter searches of the ERIC System can be made at 
several universities and through the main CEC/ERIC 
Center (Washington, D.C.). Since the search is more 
than likely to yield information on some university 
and R & D Center demonstration projects, the next 
step is to write to the original developers for infor- 
mation on the availability of materials. 

Numerous secondary reference works can be used 
in a similar manner, lr\ the annotated bibliography 
at th*^ end of this chapter, some of these works are 
listed along with sources that abstract completed 
and available training materials. 



Asseeimentol instrucilonal materials 



If your search has yielded materials that appear to 
be suitable for your specific needs, review them for 
quality as well as appropriateness. Checklist 2.1 is 
^^signed to help identify the critical elements of such 
materials. 



Directions: In muttlple-'Cholce (terns, check as many 
as are appropriate. In other items, Indicate the dp- 
proximate position of the Insiructlonat materials 
along the seven-polnt scale. 

Objectives 

1. Is the material accompanied by a fisl of objectives? 

( ) Yes ( ) No 

2. The objectives are stated In; 



± 



1 2 

amblguOMS 

global 

terms 



6 



7 

behavioral 
terma 



3. These objectives appear to be derived from an 
analysis of: 

- the special teachers' tasks 
— ^ the needs of handicapped children 

current trends In special education 

the demands of the subject-matter area 

4. These objectives: 



L 



1 2 3 4 5 

coincide with 
realities of 
teaching 
exceptional 
chilOren 

5. Overall evaluation of objectives: 

/ _i 1 L^^^L 

1 2 3 4 5 

appropriate 



6 



7 

are iotaily 
irrelevant to 
teaching excep- 
tior^al children 



inappropriate 



Tests and evdiuatlon 

1. The material Is accompanied by: 

entry knowledge test 
— ^ final criterion test 

^ pretest 

- — ^ transfer lest 

other"- ■ 

2. These tests emphasize tho measurement of: 

cognitive skills 

■ psychomotor skills 

™ — alfectlvo outcomes 
other 

3. Types of test Items and measuring instruments: 
^ — :^ paper-and-pencil, objective 
™_ paper-and-pencil, essay 



scales and questionnaires 

— performance tests 
^ — transfer assignments 
observation systems 
— other 

4. How validly does the test nrieasure the stated 
objectives of the material? 



L 



± 



1 

very 
valid 



7 

invalid 



5. Overall evaluation of tests: 



± 



1 

appfopriate 



6 7 

ln«ppropri9ta 



Subldct-matter content 

1. The treatment of content Is: 
/ / / / 



.L 



1 2 3 4 5 

me«f«iie«iiy 

■ MurnJ.\ 

2. Usage of terms and conventions: 

L I I I L 



6 7 

theof«Ucally 



1 2 3 4 5 

eunenl 

3. Examples ustjd in the material: 

/ i - J / . / 



7 

out ot d4la 



1 2 

authentic 



6 7 

artidctti 



4. Instructional objectives are covered by the content; 

L / III I I 

3 4 5 6 7 

1nade<juateiy 



1 2 

adequately 



5. Overall evaluation Of subject-matter content: 



1 2 

appfopfiate 



6 7 

Inappfopriata 



Relevance to teacher trainees 

1. Level of language: 

/ , / / L 



1 

app<opf/ata 



6 7 

jrtapp^opriaie 



2. Teacher trainee Is required to participate: 

actively 

passively 

individually 

in small groups 

In large groups 

■ .. other ^ 



m 



am 



r; 3.- Difficulty level: 



1 2 

to6 eimpl6 



3 4 

appropriate 



6 7 

loo ditficuii 



ii 



S^uence: 

A logical 

psychological 

\ ^ rigid 

flexible; under learner control 

>; other 

5. Amouni of practice and review: 

L—J i__J I ^ 

12 3 4 5 

too much ftppropfiata 

6, Overall evaluation of relevance: 

L ^ / / / 



il: 



1 2 3 

high 

Packaging 

1. Type of mpterlals: 



L 



1 2 

selt- 

Inttrucliontl 



2. Adequacy Of packaging: 



package 

tncludaa ail 
raqulrernents 



JL. 
6 



7 

too littia 



low 



7 

teachar 
(tap«n<i«nt 



6 7 
packa^a ii net 
aail'COoialned; 
64»<ntial matarlaia 



3. Package contains these adjunct materials; 
— _ list of references 

follow-up activities 
— ^-.^ instructor's manual 
— ^ tests and measuring Instruments 

4. Overall evaluation of packaging: 

I L t / / / 

1 2 3 4 5 6 
elfactfvt 



RecommenU^c<i procedure for use 

1, Flexibllltyi 

t L I I 



1 2 

2. Training: 

L L 



1 2 

can t9 uMd 

arty laachar 
Iralnar 

3. equipment: 

L 



1 2 

r^o special 
equipment 
nece$»ary 

4. Logistics: 

L U_ 



1 2 

no specUl 

arranoementa 

neceasary 



3 4 

optimat 



7 

lnell««liv« 



-L L, 

6 7 

too untiructurao 



6 7 

tpactai Iralning 
nacaiiarK 'or 
ua« of inaiafiala 



7 

ap«ciat 
equlpmenl 
naceisary 



7 

ipectat 
arraftQementt 
necessary 
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5. pvdrall evaluation o( recommended procedure 

for use: 

i I ^ :^L^ L^^ , / / 

1 2 3 4 5 6 7 

efficient lnfttricl«nt 



To dmiop or not to dmlop? Maklrtg a final 
decision. i 

Based upon your critical appraisal of the material, ' 
you may make any one of the following decisi9ns: 

To Adopt) if the instructional materlal^i meet your 
objectives. 

To Adapt! If the instructional materials can be 
modified to meet your training needs. 

To Ri;|ecti if none of the available instructional 
niaterlai$ rtieet your training requirements. You will 
have tp develop your own materlal$. 

Although the Instructional development procedure 
putHhed In this sourcebook is designed to be of maxl* 
mum use In the development of new materials, it 
may ialso be of help in adopting or adapting existing 
materials* jFor example, if you decide to adopt exist- 
ing instructional materials, you will still need an 
insiiuctlonal analysis, a design of an instructional- 
management format (e.g., providing the learner with 
a hierarchy of objectives keyed to various instruct- 
ional materials or constructing a $<^t of criterion tests), 
and formative and summatlve evaluations. Proce- 
dures for formative evaluation, which are outlined 
in two of the later chapters, are useful for pinpointing 
weak areas and making revisions, if you decide to 
adapt existing matetials. 

Tha processes and stages of front-end analysis 
are illustrated in Figure 2 J. 



Final recommendation 

- Adopt. The materiol Is usable. 

Adapt. The rnaterlal may be used with some 

modifications. 
Reject. The materialis nof usable. 



mm. 



No 



Condltlons prevent 
trainee from doing 



Yes 



Trainee won't do 



Yes but they 



are not very good 



Task unpleasant 



iV 



Trainee 
can't do 



they are good 



No 



Figure 2.1 
Front-end analysis 
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8«lMtM bibllooraphy of 

Initructionii dtv^lQpmtnt reteiencd iMrces 

and madia rafarancai 



1, Qanaral and tpaclal aducation rafarancea 

Council for Educational Development and Re$earch, 
CEDAR Catalog. Center for Educational Develop- 
ment aKd Research* Denver, Colorado, 2 vol$.» 
1972. 

A two-volume con^pllatlon of selected research 
and development programs and products from 
ten national educational laboratories and nine 
university-based research and development cen- 
ters. Both available and anticipated products 
ore listed^ Areas covered Include school organi- 
zation and administration, early chtldhood, ele- 
mentary, secondar/. higher education, teacher 
education, urban, vocational education, and 
basic research. 

Current Iridex to Jourdats In Education (CUE). New 
York: CCM information Corp. MontlJy since 1969. 

An Index to over 600 education and education- 
related Journals. Indexed with subject descriptions 
from the Thesaurus or eft/C c/e$cr/ptor$. 

Rasaarch tn Education. National Center for Education 
Communication. S. Departmertt HEW. Office 
of Education. Monthly since 196$. 

A monthly abstract Journal announcing recently 
completed research and related reports in the 
field of education. RIE is Indexed A^ith subject 
descriptors from the Thasaurus of ERIC 
dascrlptofs. 

How to Conduct a Saarch Through ERIC, ED 036 499, 
microfiche 65c, hardback copy $3.29. Available 

through the ERIC Document Reproduction 

Service. 



Excaptlonal Child Education Abstracts. CEO Infor- 
mation Center (CEC, ERIC Clearinghouse), 
Arlington, Va. Quarterly since 1969. 

A quarterly, Indexed publication of abstracts of 
special educiJtlon documents that are stored in 
the CEC Information Center, Indices cumulate 
annually by subject, author, and lllle. 

2. Inilructionai materiata for taacher training 
rafararicaa 

Berger» A. C, Tonjes, M. J., Abbott, A- B.. & Splnp. 
W. 6, Florida Cantar for Taachar Training Ma- 
tarlala Annotated Catalog of Ta^char Training 
Mdfer/ate» Coral Gables, Florida Florida Center 
for Taacher Training Materials. University of 
MlamU972.321 pp. 

An annotated catalog of competency-based 
teacher training materials. All materials are 
classified under one of 29 taacher competencies, 
e.g., generic teaching skills, language arts, 
reading, etc. Source Index lists materials by 
producer or developer, 

Information provided for each moduje annotated 
In the catalog includes title, author, publisher or 
developer, teacher compelenct^s emphasized 
In the module, brief description of the material, 
Intended consumer, cost, number of pages, 
estimated time to completion, and nature of the 
audio-visual materials Included. 

Houston. W. R.. et al. (Eds.) Resources for Per- 
tormanca-Ba^ad Education. Albany, N.Y.: Slate 
Education Dept., University of the State of New 
York. March. 1973. 
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Probably thd most useful catalog of instructional 
re souces for teacher education to date. It is an 
Indexed and annotated listing of instructionat 
materials In alt media and formats, except 
textbooks^ 

Korba, W. L, Cawley, J. P., & Pappanlkou, A. J, 
Catalog of Decision System Films, University of 
Connecticut, Storrs, Connecticut, 1972. 

A catalog of special education training films 
produced at University of Conneoticut< Each film 
presents a problem area in general and specltii 
education and Is Intended to provide a common 
basis for a discussion and study which should 
follow viewing. Some topics: academic freedom, 
superintendent selection, special education and 
the taw, special education budget cut, teachers' 
union, special education placement^ and others. 

Blatt, B. (Ed.) Selected Merf/a Reviews 1970-1973. 
Reston, Va.: Council for Exceptional Children, 
1973. 

Reprints of Media Reviews appearing in Excep- 
tional Children. Includes mainly book reviews, 
with some reviews of films and other media. 
Reviews are detailed, some with authors* com* 
ments on the review. CEC updates these re- 
prints periodically. 

Melerhonry, W, C. {Ed ) Mpw/^fed Teacher Education 
Resources: Supplemental Media Resources for 
Pre-sen/ice and In-sen/tce Teacher Education 
Programs. Washington, D.C.: American Associ* 
ation of Colleges for Teacher Education, 1970. 

An annotated bibliography, prepared by the 
AACTE Subcommittee on Education Technology 
In Teacher Education. The referenced are classi- 
fied by media only. There Is no breakdown of 



listings by subject area. It is a good source for 
selecting mediated teacher training mat^;r(als 
curryntly In circulation. 

Zuckerman, 0. W,, & Horn, R. E, The guide to 
stmulationgamestor education and training. 
Cambridge, Mass.: Information Resources, 1970. 

An extensive Informational guide to games and 
simulation games Indexed by subject, author, 
title, and producer. The Index for each subject 
division contains Information on target population, 
number of players, and time required for each 
game. 



3. Media references 

NICEM Indexes. National Information Center for 
Educational Media (NICEM), University of Southern 
California, University Park, Los Angetes. Cali^ 
fornia 90007. 

An audlo-visuat reference series. Each index 
covers educational materials in six different 
media. Vocational and technical education, 
psychology, and health and safety education 
are covered in three separate multimedia Indices. 
All entries are annotated and a subject heading 
outline is included. Detailed and relatively ex* 
pensive, the series is suitable as an A.V. library 
reference source. 

Westinghouse Learning Corporation. Learning 
Directory. 7 Vol. New York. 1970. 6700 pp. $90. 

A comprehensive guide to teaching materials 
at all levels, including print and nonprint materials. 
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Chapters 
Learner analysis 



Obiectlves 

1 . Identify various types of target trainees for whom 
materials for teaching exceptional children are 
to bd devefoped. 

2. Describe the process of learner analysis and re- 
late it to other steps in instructional development. 

3. Analyze characteristics of the target population 
relevant to instfuciional development. 



Learner analysis is the preliminary stage of instruct^ 
ional development in which the characteristics of 
the target students which are relevant to the design 
of materials are identified. It is important for train- 
ers to remember that target students are not ex- 
ceptional children but their teachers, either pre- 
service or inservice trainees. The target students 
also may be other important persons involved 
in the education of exceptional children: adminis- 
trators of special education programs, resource 
teachers, consulting teachers, school principals, 
teachers' aides, and parents. Training materials can 
be designed for groups of any of these persons pro- 
viding their relevant characteristics are taken into 
account. 



Who are th0 learnerft? 



Ideally, instructional materials should be tailor- 
made for the individual trainee. However, the ideal 
may result in over-individualization as the more 
materials are individualized the less appropriate 
they are for other students. Thus materials designed 
speciFically for one teacher trainee may be relatively 
ineffective in meeting the needs of other trainees. 
At the other extreme are materials which are de- 
signed fo/ all actual and potential teachers in special 
education. The effectiveness of such materials may 
be less than desirable because to be suitable for so 
broadly defined an audience, the material is neces- 
sarily very general in nature. Hence it is essential 
that the dermition of the target students be broad 
enough to permit some generalization of the material 
but not so broad as to reduce the material's ef- 
fectiveness. The more carefully the target students 
are identified, the greater the number of them who 
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ChecMlsl3.2 

Uarnor-anatyalsfcr ihe dovelopmont ol 
t0ach6Mrain(ng maforials in spoclaf education 



will find the material effective, although not neces- 
sarily each to the same extent. 

Any given set of target students shares a number 
of unique characteristics that differentiates it from 
other groups. Yet, within this group, there can be 
distinguished subgroups differing from each other, 
Therefore, an analysis of a group of learners must 
focus on not only the similarities but the differences 
characterizing the group* Analysis should indicate 
both the *'average" set of characteristics and its 
**spread/' If, for example, we identify two clear- 
cut subgroups in the target population, the develop- 
ment of two different forms of training materials 
may be useful. If the group differs on only one 
characteristic, variety of background experience^ for 
instance, the training materials can stilt be useful 
for the whole group if additional and more varied 
examples are added. 

Why learner analysis? Learner analysis directly 
affects all succeeding stages of instruction develop- 
ment. Learners' preferences determine media and 
format decisions and learner characteristics dictate 
such factors as language, style of presentation, choice 
of examples, size of learning steps, and nature of 
sequence* Learner analysis helps to insure that cri- 
terion tests are not contaminated by irrelevant factors. 
To a large extent, final packaging and dissemination 
also depend upon the characteristics and preferences 
of trainees. 

What is to be analyzed? Although thousands of 
characteristics differentiate individual students and 
target groups, many are of trivial importance insofar 
as the design of instructional materials is concerned. 
The variables in the following learner-analysis 
checklist for teacher training materials in special 
education were selected on the basis of extensive 
developmental experience. 



Subject-matter compotenco 

1 . At what levels are the trainees' current knowledge 
and skills In the subject-matter area? 

2. What background experiences do the trainees 
have In the subject-matter l^rea? 

3. Are the trainees likely to have any major mis- 
conceptions in the subject-matter area? 

Attitudes 

4. What are the general attitudes of the trainees 
toward the instructional content? Are there any 
subtopics within the content toward which the 
trainees are likely to feel very positive or very 
negative? 

5. What preferences for Instructional format and 
media do the trainees have? 

Language 

6. What is the language level of the trainees? How 
much of the specialized terminology is in their 
vocabularies? 

7. What preferences for style of language (e.g., 
conversational or scholarly) do the trainees have? 

Tool Skills 

8. Do the trainees have any sensory-perceptual 
deficiencies that will require special attention? 

9. Can the trainees handle the instructional ma- 
terials and equipment? 
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How to conduct i Uarner «nr?yftU 



Learner an%sis Is the Identification of the 
learners* aciuat entry characteristics as opposed to 
the ideal (or prerequisite). When the target students 
are enrolled, the following informal techniques may 
be employed to perform a learner analysis. 

□ Recall. It is extremely likely that, as a teacher 
trainer, you have considerable experience with tar- 
get students. Systematic use of the checklist should 
aid in the recall and listing of various relevant lecrner 
characteristics. 

□ Interviews with other teacher trainers. Tap the 
experiences of other teacher trainers by Informally 
interviewing them. By carefully :{electing a variety of 
special educators, a better picture of the diversity of 
the target students can be obtained. 

□ Research literature. Selected studies on the char- 
acteristics and attitudes of special education teacher 
trainee$ are listed at the end of this chapter. These 
studies may help interested trainers to obtain data- 
based listings of trainee characteristics. 

□ Interviews with the learner. Through face-to-face 
interviews or by administering a self-report question- 
naire to trainees, a list of their relevant character- 
istics may be obtained. 

□ Criterion test. Perhaps the most important learner 
characteristic in the preparation of instructional 
material is the extent to which the terminal behavior 
has already been acquired. To pinpoint exactly the 
level of the learner on the continuum of objectives, 

a criterion test is administered to a random sample 
of the target students. 



Sample learner analysis 

The following is an example of the application 
of the learner-analysis technique outlined in Check- 
list 3.2 to preservice teacher tritnees enrolled in 
a typical rnethods course. It is from a training 
modul;' instructional games entitled, Let's Design 
Games thai Teach Handicapped Children (Thla- 
garajan, 1970). 

$ubJ«ei*inaH«r comp«l*nc«. Trainees have a consider- 
able theoretical krK>wledge of different types of handi- 
capped chltdrtiNri end speelal cli$$roorns. they are 
krvowVddgeable ehough In specific cur ricular areas to 
work with a topic for instructional g$me design. They 
have heard about Instructional games and have seen 
them being used fn special ctassrooms. However* very 
few of then) have considered the possibility of designing 
a game. Their cpnceptlon of instructional games is mostly 
limited to fun activities and "busy work." 

Attlltidfl. The tri^ineeV genera) attitude loWerd de* 
signing Instructional games Is positive, altiVPugh they are 
somewhat skeptical as to the games* uses. Most of them 
believe that a game could be designed very eaelfy, and 
the amount of time required for the design, tryout, and 
modification of a game will Increase their skepticism. 

These trainees do not like a textbook-lecture approach. 
They will respond posftVely to a self-instructional media 
package. 

Languege. Speclaifzed Instructional-ds^gn and game- 
design terminology Is not part of the trainees* vocabu- 
laries. They can, however, handle fairly sophisticated 
terminology about handicapped children and special 
education. Trainee preference is for a conversational, 
rather than a "textbooktsh," style. 

Tool skUle. Trainees do not have any malor handi- 
capping conditions. They wiii be able to handle media 
equipment with some instructions. 
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charactorliilci and atlltudeiof 

spaclal education (aaehars and teacher trainees 



BadI, M. Attitudes of university students toward ex- 
ceptional children. Exceptional Children, 1957, 
23/286-dO. 

Compared coltefle education majors with non- 
majors. Found negative attitudes prevf led In 
t>oth groups. Fleacllons to speech, hearing, and 
visual handicaps were more positive than to 
Intetlectual and emotional disabilities. 

Bullock, L. M., & Whelan, R.J. Competencies needed 
by teachers of emotionally disturbed and socially 
maladjusted: A comparison. Exceptional Children, 
March 1971, 37. 485-489. 

A comparison between teacher responses In the 
Mackle {1959) study with a group of similar 
teachers In 1970. Significant changes reported 
In teacher perceptions about competencies re- 
quired and ratings of own proficiencies. 

Gottfried, N. W., & Jones, R. L. Career choice factors 
in special education. Exceptional Children, 1964, 
30,218-23. 

Studied factors influencing choice of a career 
In special education. The most frequent reasons 
stated for entering the field were previous con- 
tact with the handicapped, desire to help others, 
and the challenge of the work. 

Jones, R. L Teacher education: Preferences for 
teaching Intellectually exceptional children. 
Education and Training of the Mentally Retarded, 
February 1971, 6, 43^48. 

Teacher trainees and practicing teachers were 
studied to determine how grade teaching prefer- 
ences were related to preferences for leaching 
exceptional children. 



Jones, R. L., & Gottfried, N. W. Psychological needs 
and preferences for teaching ux^oeptlonal chil- 
dren. Exceptional Children, 1966, 32, 313-321. 

Used Edwards Persorral Preference Schedule and 
Teacher Preference Schedule. Identified a num- 
ber of personal variables related to preferences 
for teaching certain exceptionalities. 

Mackle, R. P., & Dunn, L. M. Teachers of children 
who are blind. Office of Education, HEW, Wash- 
Ington, D. C, 1955. 

Study is part of a nationwide survey on the quali- 
fications and preparation of teachers of except- 
ional children. Reports on the distinctive com- 
petencies and experiences nieded by teachers 
of blind children. 

Mackle, R. P„ Williams, H. W., & Dunn, L. M. Teachers 
of children who are mentally retarded, U. S. 
Department A.E. W. Office of Education, HEW, 
Washington, D, C GPO Bulletin No. 11. 1957. 

Part of series on teachers of exceptional children, 
based on nationwide survey of preparation and 
qualification of teachers of exceptional children. 

Mackle, R. P., Kvaraceus, W., & Williams, H, Teachers 
of children who are socially and emotionally 
handicapped. Office of Education, HEW, Wash- 
ington, D. C, 1957. 

Survey of teachers In the area of emotlonaliy and 
socially disturbed children as to competencies 
required and ratings of own proficiency. 

Mackle, R. P., et al. Teachers of crippled children 
and teachers of children with special health 
problems. Office of Education, HEW, Washington, 
0. C..1961 
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Survey of teachers In areas of crippled and 
special health problem children. Includes teacher 
self-appraisal, special abilities, and experience 
needed. 

Melsge(er» C. The identification of successful teach- 
ers of mentally or physically handicapped chil- 
dren. Exceptional Chltdren, 1965, 32, 229-235. 

Investigated five dimensions of human behavior. 
Found three characteristic patterns of successful 
student teachers: (a) they were well-adjusted, 
emotionally stable* (b) possessed physical energy, 
vitality* and enthusiasm, (c) obtained high scores 
on measures of scholastic achievement ability, 

Rudloff, Joseph S. Descriptive profile of teachers 
of exceptfonal and non-exceptional children with 
Implications for rec ruilment. Journal of Educa- 
tional R$$earch, November 1969, $3. 130-135. 

Examination of personality profiles of teachers of 
hard of hearing and regular classroom teachers. 

Semmel, M. I. Teacher affi ides and Information 
pertaining to mental deti ;lency. Amefic&n Journal 
of Mental Deficiency, 19f>9, 53, 566-74. 

Investigated the relationship between the amount 
of information teachers have about mental de- 
ficiency and their attitudes toward mental 
deficiency. Found special education teachers 
had more knowledge of mental deficiency than 
elementary teachers but did not differ signifi- 
cantly on attitudes. 

Semmel, M. I., & Dickson, S. Connotatlve reactions 
of college students to disability labels. Except- 
ional Children, 32, 1966, 443-450. 



Investigated reactions of elementary and special 
education majors to various disability labels. 
Found significant differences toward different 
disabilities, and differences as a function of var- 
ious social-psychological situations. Special 
education majors had higher mean attitude scores 
compared to elementary education majors No 
significance between mean attitude scores for 
freshmen and seniors of either group. 

Semmel. M. I, et al. An exploratory study of the 
relationship between the training, experience, 
and selected personality characteristics of 
teachers and the prog ress of trainable mentally 
retarded children. Final report, Wayne County 
Intermediate School District, Detroit, Michigan. 
June 1969 665 pp. 

A study of the relationship between certain 
teacher characteristics and TMR pupil growth. 
Examined teacher characteristics, attitudes, aud 
preference for teaching various types of children 
and grade levels. 

Wiflman, C. E. A comparison of prospective special 
education and elementary teachers on selected 
personality characteristics. (Doctoral dlsser- 
tallon, University of Michigan) Ann Arbor. 
Michigan, University Microfilms, 1966. No. 
67-8367. 

Investigated differences between special edu- 
catiof^ and filamentary teachers on the Edwards 
Personal Preference Schedule, MTAI, the Study 
of Values, and biographical data. Found small 
differences among special education majors in 
the various areas of exceptionality* but signifi- 
cant differences in basic needs, attitudes, and 
interest between prospective elementary and 
prospective special education teachers. 
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Chapter 4 
taskahalyslft 



Objectivds 

1. Doscribe tho task analysis procedure and relate 
it to other st^ps in Inslructlonal development. 

2. Given a statement describing an instructional 
task, perform a task analysis and list various 
s'jbtasks In a hierarchy. 

3. Evaluate and revise the outcomes ol task analysis 
so (hat they are comptete and include no irrefe- 
vanMfivlal, unnecessary, or redundant subtasks. 



Task analysis is a preliminary step in itistructional 
development. It is the means by which the Instruc- 
tional task is broken down into various component 
subtasks. 



Why la$k analysif? 



Task analysis forms. the basis for both the con* 
struction of measuring^jnslfuments and the design 
of instructional materials. The type of instructional 
task, as determined by this analysis, helps to deter- 
mine the media to be used. For example^ a basically 
nonverbal task such as visual prompting lends itself 
to the use of film or video tape, While a verbal task 
such as questioning may be taught primarily throygh 
audio tape. The type of task also suggests the in* 
structional format; A complex interrelated set of 
tasks will lend itself to the use of a simulation game. 
The sequence of subtasks suggests the sequence of 
instruction* In the editing stage of instructional 
development, a subject-matter specialist need go 
through only the task analysis (rather than the 
entire package) to qheck the adequacy of coverage 
and the suitability of sequence. Finally, in the dis- 
semination stage, the task analysis enables a potential 
user to get a quick overview of the content of the 
package. 



How to perform a taak analysis 



Basically, task analysis involves the study of a 
master performer*s behavior and the identification of 
its components. In the case of a psychomotor per- 
formance (e.g., how to fix a hearing aid), task analysis 



may Involve primarily the observation of a skilled 
performer In addition, the instructional developer 
may also try his hand at performing the task— doing 
his analysis while learning the task. With cognitive 
skills (e.g., how to write teacher-made reading 
materials), the analysis depends more upon interviews 
with subject-matter experts than upon observation. 
In addition, textual materials, test items, currleular 
guides, and other references can be used to add 
greater depth and generality to the analysis; In the 
case of innovative techniques for teaching, when no 
expert performers and reference materials are 
available, a useful technique is to imagine a hypo- 



thetical performer and analyze his ^'behavior." 

Because task analysis is a step-by-step process, 
any of which may require rewriting several times 
before it is in final form, a chalkboard is a very 
efficient teaching aid. 
Steps in an actual task analysis follow: 
1« Specify the main task. This step requires a 
comprehensive statement of the task's objective. It 
should Indicate the $kill the trainee Is expected to 
acquire upon the completion of instruction and the 
situation In which the skill will be used. On the top 
center of the board, a main task may be stated as 
follows: 





Figure 4.1 
Task anaTysis: step 1 
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2. Identify subtasks at the preceding level of 
complexity. This step is accomplished by asking, 
**What sicllls should the trainee possess in order to 
perform the main task?*' Obviously hundreds of skills 
contribute to any performance but, at this stage, we 
are interested only in identifying those that immedi- 
ately contribute to our main task. I he sample main 



task {Fii, 4« 1 ) logically breaks up into the subtasks 
of administering the test and interpreting its results. 
As shown in Figure ^.i, these two subtasks are placed 
below the main task and lines are drawn to indicate 
their relation to the main task. 




Figure 4.2 

Task analysis: step 2 



3. Treat each subtask as a main task and repeat 
the analytic procedure. We took each of the two 
subtasks in our illustration (administering test and 
interpreting test results) and identified the tasks at 
the preceding level of complexity which are necessary 
for its performance. Thus the task of administering 
the test broke down into the four elementary sub- 




Figure 4.3 

Task analysis: step 3 



tasks of (a) choosing a suitable book» (b) choosing 
passages for reading from this book, (c) having the 
child read the passages, and (d) counting the number 
of errors he makes. The chalkboard would now look 
like this: 
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4. Terminate analysis when subtask reaches the 
entry level of the teacher trainees. Analysis of the 
task can be halted at a logical point. In our illus- 
tration (Fig. 4,4). at the third level, the task broke 
down into two sublasksi finding the highest grade 
level from the child's records and choosing a basal 
reader* We stopped the analysis here as both skills 
were within the trainee's entry level (determined 
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by an earlier instructional module on selection of 
books at different grade levels and Identification 
of reading errors). Had we carried the analysis 
down, we would have had to Include counting off 
100 words and deciding if a number is greater than 
five, skills obviously within a trainee's repertoire/ 
The completed task analysis is shown in Figure 
4.5. The value of a chalkboard should now be 
obvious. 
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Figurd 4.4 

Task aaalysis: step 4 



Completing the task analysis. When the analysis 
is complete, prepare a list of all major and minor 
tasks and carefully review it to make sure that suf- 
ficient and necessary subtasks have been included. 
Checklist 4.1 should be useful for this purpose. In 
addition to using the checklist, it is a good idea for 
the analyst to get opinions of the analysis from col- 



leagues. They too may use the checklist or they may 
classify the task analysis items in terms of "irrele- 
vant/V"relevant-but-trivial," and "essentlaP 
categories. 





F)flUfd4.5 

Task analysis: step S 
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Additional exaniptei of task analysis The following 
illustrations are taken from actual instructional ma- 
terials for training teachers of exceptional children. 
Note that each analysis begins with the terminal 
performance and works backward through different 
levels of prerequisite skills. All task analyses are 
terminated at the entry level of the target trainees. 
Some divergence among entry levels can be seen 
bvcause each analyst worked with his specific target 
trainees. 

Figure 4.6 shows a fairly simple analysis of a 
psychomotor skill. It is part of an instructional 



package on the use of cameras in deaf education 
classrooms to enhance the children's visual literacy ^ 
(Stallings, 1972). This analysis was made by »>b- 
servlng photographers* performances and by examin- 
ing instructional manuals (on camera usage). 

The next analysis deals with the tasks of develop- 
ing Instructtonal materials for parents to use with 
tljelr handicapped children and training parents to 
use the materials. The analysis is based on a series 
of journal articles and class handouts written by 
different special education instructors. The contents 
of the materials were analyzed and the subtasks were 
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Analysis of using a cm$ra 
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riflure 4.7 

Analysis of (ask of teaching handicapped children through parents. 
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derived from them. Figure 4.7 shows only part of 
the analysis; all tasks shown ia the boxes with an 
open line need further analysis into more elementary 
subtasks. 

The main task for the special education te^^cher 
in Figure 4 J is involving parents in the teaching of 
their handicapped chlldr^^n. The task requires that 
the teacher prepare instructional materials that need 
little or no Instructional decision-making by parents. 
Three basic types of such materials arc identified 
in the analysis: programed tutoring materials, In^ 
slructional games, and specific lesson plans. The 
preparation of each involves a number of subtasks 
which Jite not shown. Another aspect of the parent 
involvement Is to train them to use these Instructional 
materials and to provide them with relevant practice. 
Such practice involves the subtasks of arranging 
simulated situations In v;hich the teacher and the 
parent can play the roles of parents and children, 
classioom situations in which parents can practice 
tutoring under the supervision of the teacher, and 
home situations in which parents function on their 
own. The training task is analyzed Into the three 
subtasks of writing a parentis manuaK demonstrating 
specific teaching skills, and getting parents to teach 
each other. Figure 4.7 shows further analysis of 
only one of the three subtasks, ^Training through 
demonstration," In order to give a demonstration, 
the teacher must have the skills to show the parents 
proper seating arrangements and how to point out 
specific items for the child to observe, a>k ap- 
propriate questions, and reinforce the ch^ld*s re- 
sponse. The analysis of this branch is terrHnated 
at this level because the learner analysis indicates 
that the target trainees (experienced special teachers) 
are able to perform these tasks. 

The last sample is an analysis of a more complex 
task for les:i sophisticated target trainees (Fig. 4.8). 



The task is the use of an observation coding system 
in a classroom for emotionally disturbed children. 
This particular system (Fink & Semmel, 1971) Is 
concerned with deviant classroom behaviors manl« 
fested by children and the control techniques used 
by teachers. The target trainees were a heterogeneous 
group of substitute teachers and aides who had been 
hired as coders for a research project. Since even 
the originators of ih$ system could not code all rel- 
evant behaviors with absolute reliability over a long 
period of time» the analysis was based on the per- 
formance of a hypothettcal perfect coder. 

The task required of this Ideal coder was to observe 
a classroom and record, once every five seconds, the 
occurrence of relevant categories of behaviors (e.g.i 
student physical aggression and teacher control 
through punishment). The task was analyzed Into 
the subtasks of the ability to discriminate between 
different categories of behavior (e.g., between verbal 
and physical hostility) according to the system, work- 
ing under external pacing (i.e,, recording every five 
seconds), tolerating noisy distractions in the class- 
room which did not come under the domain of the 
system, working without any feedback on the ac* 
curacy of coding, and efficiently using a special 
machine-readable recording sheet. Figure 4.8 shows 
the further analysis of the last of these subtasks into 
the more elementary subtasks of locating boxes and 
coloring bubbles on the coding sheets. 
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Figure 4.6 

Analytitof the task of coding reliably. 
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Chockli9t4.l 

Annlyxihg teacher tasks in special education 



Relevance, is the main task relevant to the ef* 
fective performance of a teacher in a real-world 
classroom with handicapped children? 

Completeness. Are enough subtasks listed to 
cover the performance of the main tr^sk? Has any 
essential subtask been omitted? 

Triviality, b any subtask included which is simpler 
than the entry level of the target trainees? 

Necessity, is each subtask necessary for the 
performance of the main task? Are any of the sub- 
tasks unnecessary? 



Redundancy* is ^ny subtask repeated more than 
once with or without minor changes in wording? Is 
any set of sublasks an alternate for the performances 
contained In another set of subtasks? 



The first item In the checklist is included so that 
the trainer will seek other opinions. Familiarity 
with a task may lead one to take certain skills for 
granted and omit them. For example, in the design 
of a training module on grouping EMR children 
for instruction, we assumed that all teacher trainees 
knew how to estimate the mental age of a child, given 
IQ and chronological age. It turned out to be a poor 
assumption; the trainees had to be taught (or retaught) 
the procedure. One way to check the completeness 
of task analysis is to train a naive student on the 
listed subtastiS and see if he can synthesize the main 
task. 

Inclusion of trivial tasks is an error at th^ other 
extreme. A trivial task is one below the entry be- 
havior of the trainees. In the same module on group- 
ing EMR children, we included a segment on com- 
puting the mean of two scores. Such a task, though 
essential, was already in the trainees' repertoires; they 
required only to be told when to do it, not how to do it. 

The trainer is frequently tempted to list unneces- 
sary tasks merely because of tradition. Alt tasks 
somehow seem relevant to all other tasks and it is 
very difficult to be objective. In our module on 
grouping EMR children, although we did not include 
such obviously unnecessary items as knowledge of 
a history of grouping in classrooms, a few question- 
able items escaped detection. The major problem 
with irrelevant tasks is ihat they are readily detected 
by trainees and may evoke student negativism. 

A comprehensive task analysis takes up consider* 
sb]y more time than dashing off an outline. A quick 
vask analysis may appear to save time but it can 
result in an inadequate design that will necessitate 
expensive modifications in later stages. 




Chapter 5 
Concept analyeia 



Ob|octlv0i 

1. Driefty describe the process of concept ana1> ^is 
and relate it to other steps In the Instructional 
development process; 

2. Given a set of related concepts, arrange thorn In 
a concept hierarchy. 

3. Given a concept, analyze It Into critical and Ir- 
relevant attributes and specify different types of 
examples and nonexamples to be used for In- 
struction and testing. 



The technique of concept analysis is similar to that 
of task analysis except for the content to which it is 
applied. Task analysis is used when skill development 
is the goat of Instruction. Concept analysis is used 
when the ccquisition of knowledge is the goal. Since 
the basic framework of acquiring knowledge is con- 
ceptuali the use of task analysis for such knowledge 
would result in the idenliflcalion of trivial tasks like 
the ability to recite a definition. By using concept 
analysis, however, the instructional developer can 
analyze a set of concepts which are pertinent to the 
teaching of exceptional children, arrange them in 
hierarchies, and identify the critical and iiicievant 
attributes of each. 



Nature o: ^^onceptt In the education of 
excoptlonal children 



Before discussing concept analysis, we will try to 
clarify the concept of concept itself. From an in- 
structional point of view, a concept may be defined 
as a collection of stimuli (and their relations) which 
evokes a common response. In more general terms, a 
concept is a category with a set of criteria for deicr- 
mining what (o include or exclude from that category. 
The characteristics shared by all objects or events in 
a concept category are termed **crilical attributes." 
They are the essential criteria for membership in 
that concept category. Characteristics which are 
shared by some but not all members of the concept 
category arc**irrelevanl attributes," Related concepts 
belong to a **superordinatc category ' or a "concept 
hierarchy." The relations of these terms arc graph- 
ically depicted in Figure 5. 1 . 

The concepts frequently encountered in the edu- 
cation of exceptional children share two major 



characteristics: (a) They are usually categories of 
events rather than objects and they involve behavioral 
attributes of pupils and teachers, often in interaction 
with each other, (b) The«c concepts are systematically 
created out of analyses of behaviors and interactions 
of pupils and teachers and unlike the more open- 
ended ordinary language concepts, they have rigidly 
defined bcundarits. 



How to do a concept analysis 



Contrary to the implications of Figure 5. 1 , concept 
analysis seldom progresses deductively from the 
superordinate category through individual concepts 
to subordinate attributes. Rather, it is a back-and* 
forth movement across various levels. The end 
product of the \iialysis may be a chart like Figuic 
5.1^ which lists critical and Irrelevant attributes. 
The star*>ing point is usually a collection of real or 
imaginary examples and alternative definitions of 
concept categories. 
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Figure 5.1 

Retatlonthlp between conceptual hlerftrchy 
concepts^ and attritnites. 
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A good beginning may be made with clear-cut 
positive examples which permit us to say, "Well, 
if {h<it lsn*t an example of so-and-so, then nothing is*' 
(Wilson, 1963, p, 2S). Taking the concept of physical 
aggression as a sample, a strong positive example is 
the case of an emotionally disturbed child hitting 
another child in the classroom* By comparing and 
contrasting this ej^ainpl^ with others, such as those 
of a "normal" girl biting her teacher, a boy kicking 
his neighbor, and other children hitting^ throwing 
things, and spitting, we come up with shared and 
variable attributes which enable us to Identify physical 
aggression/ To find out what physfcar is 
not, wc analyze nonexamples {ll^haviors tha) n^a'^e 
us say, "Well, whatever so-and*so Is/ It certainty is 
not an instance" (Wilson, 1963, p, 29]). TWo chil- 
dren walking arm in arm is defihiteiy a nonexample 
of physical aggression. 

Once we have Identified the major attributes of 
the concept and classified them as critical or Irrele- 
vant, we are ready for some finer discriminations 
based upon the analysts of borderline examples and 
close*in nonexamples. In the case of physical aggres- 
sion, how do we classify one child's hitting another 
at the teacher** direction (i.e., a boxing lesson In 
physical education)? If a child hurts himself, is that 
physical aggression? If a child throws a stone through 
a glass window? Or makes a verbal threat to kill the 
teacher (but does not carry it out)? If a child shoves 
the person in front of him in the line because every- 
one behind him is shoving? If a child accidentally 
trips another child? If the teacher physically evicts 
a child from a seat that does not belong to him? What 
If a child performs the same act? What if a boy hits 
back after being attacked by another child? 

Through grappling with such borderline cases we 
clarify the concept and come up with a tighter set of 
critical and irrelevant attributes as well as with sug- 



gestions for new categories in which nonexamples of 
the original concept become examples, the end result 
of this stage of p.nalysts is the specification of a set of 
critical and irrelevant attributes. The following list 
adapted from the Indiana Behavior Management 
System (Fink & Semmel, 1971), gives the critical 
and Irrelevant attributes of the concept of physical 
aggression, insofar as a teacher is concerned. 



Concept of ph/$IOdl •ggrottlon 

Critical aHrlbutM: 

1; An act of a pupil, 

t Pupil \$ nof working on the task asslgi^o i t>y th^ 
teacher, 

3. PupH Interacts with soma other persor.. 

4. His Interaction Isphysteal 

6, The phyiica) Interaction Is Intentlpnany unfriendly. 

Irrolevant ittrlbirt#i: 

1. the larqet of pKyilcal aggression can be another 
pereonr^a pupil teacheh or someone elsoi or more 
thin one perlon, as In the case of a single child 
fighting the entire ciaie. 

2. Aggreeilonmay take e wide variety oHorme, euoh as 
hitting, Klcklffij, epIHlng, throwing thlnge» and pushing. 

3. Physlcel aggreseloh may or may not be aocompanied 

by verbal eggreeelon (Insgltlrvg, abusing, and swearing). 

4. Phy$loalaggressloriaere(ailark)ntsclassllledthe 
ssme ae an initiatory aggression. 

5. Physical aggresiton need not always take place in 
the classroom. 

The attributes list prescribes the nature of the 
examples and nonexamples to be used in teaching 
the concept and testing the teacher trainee's mastery 
of it. The list also assists in the generation of an ade* 
quate definition of the concept. 

Usually, a set of related concepts is analyzed in a 
parallel fashion. After the attributes of each concept 
have been identified, they are compared across cate- 
gories to locate clusters of concepts. The outcome of 
such a comparison is a concept hierarchy which is 
very similar to the outcome of a task analysis. Figure 



S.2 show^ a sample hierarchy of a set of concepts 
related to deviant pupil behavior. The genera! area 
of interest, pupil behavior, is dichotomized into on* 
task and off-task behavior. Off-task behavior is 
subdivided into two major categories, the pupil acting 
alone or interacting with someone. Individual be- 




havior is next divided into silent (e.f;., daydreaming) 
and noisy (e.g., whistling) categorieb% which are 
labeled selMnvolvement and noise^ respectively. 
Interactive behavior is divided into phydcal and 
verbal categories; each in turn can be friendly (e.g., 
touching or whispering to someone else), aggressive 
(e.g., punching someone elseor shouting insults at the 
teacher), or resistive (e g., pullin/j away from the 
teacher or verbally refusing to catry out teacher 
directions), The following definitions of the various 
concept categories In this framework are basec! on 
Fink an<iSemmel(197l). 
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f l0ure G,2 

Hlerarehy of a $et of concepts related to pupil 
behavior, based on Fink and Semmel (1971). 




Pupil attending to teachor or to other persons or objects 
related to the lesson as defined by the teacher. 

8tK*lnvotvement: 

Pupil Is "alone*' and quiet No verbal or physical Inter- 
action with others, that is, staring, daydreaming, playing 
with self or other objects, muttering to self, wandering 
around alone or sleeping. 

Noise: 

Verbal and physical behavior Is noncommunlcative and 
dliruptlve, such as slamming a desk, tapping feei 
whlstllng» or clapping hands, and not an Integral part 
01 task. 

Physlci^l lnttracttor>: 

Friendly Interactions are not aggressive, as for example, 
playing a gama. touching someone, etc. 

Physical aggrtislon; 

Physical attack, luch as punching, hitting, spitting, 
throwing something at someone. etCi is directed against 
peers or telcher. 

Physical reslslanoe: 

Phyalcai refusal to cooperate with teacher directions, 
such as sIttfrHi atlll and continuing to misbehave or using 
physical force to resist teacher. 

Verbal Interaction: 

Talking when not supposed to In a nonaggresslve fashion. 
Verbal aggression: 

Insulting, abusive, angry statements directed toward 
peers or teacher. . , 

Verbal reslslaiice: 

Verbal refusal to carry out teacher directions (either to 
do a particular task or to stop misbehaving). 



Graphic charts, such as Figure 5.2 and, rpore 
importantly, the process of arriving at them, help in 
a number of ways. In addition to providing a frame- 
work for a set of related concepts, they facilitate the 
location of gaps in the concept hierarchy. Later, 
during the design of instructional materials^ the 
various levels of concepts suggest diverse sequencing 
strategies. Examples of a concept may be used also 
as effective nonexamples for another concept at the 



same level Since the concepts at each level share a 
number of attributes and differ only in critical attri- 
butes, they require the teacher trainee to make fine 
discriminations. 

Additional examples 

There follow some additional examples of concept 
analysis from the area of behavior management 
techniques used by teachers. Figure 5.3 presents a 
hierarchy of concepts related to tejwher control 
techniques followed by brief definitions of the con- 
cepts. An analyst of one of these concepts— em- 
pathic Control— Into critical and irrelevant attributes 
is also presented. 

Dallnltlona of a Ml of conc^wla relatad to teacfi^r 
control techniques, bated oh fink and Semmel (1971). 
Instruction: 

Any teacher behavior related to the iesson. In general, 
it Includes all teacher behavior which has not been 
Initiated by pupil disruptive behavior. 

Threat: 

Verbal statements specifying or Implying that negative 
consequences or punishment will loltow the misbehavior 
of the pupil. 

Incentive: 

Verbal statement specifying or implying that positive 
consequences or rewards will follow the cessation of 
misbehavior by the pupil. 

Empathic control: 

Teacher expression of understanding the pupil's feelings 
and behavior. 

Probe: 

Teacher questioning to find out (or get the pupil to think 
about) the reason for misbehavior. 

Humor: 

Teacher attempts to reduce tension and control pupil 
behavior by means of jokes, clowning, asides, or other 
such activities without intent to critlcire the pupil. 



Authority d#mi4i<f: 

Dlfool verbal command* to'ceaie and desiat in firm, 
authorltatlva lona, 

Slflnal domand: 

A conditlonad-itimulua tignal (a.9., calling the pupll'a 
name. ''Shhh/' pauaa» or atarlno) roquirino Ihn pupil to 
atop mlabahavtng. 

Valut-lawdamand; 

Teacher axplicitiy reminding pupM of the a$tab|[»hed 
rufea of bahavior in the ciaaaroom by daacrlbing or 
referring to the behavior norm. 

Crlttcltloo? 

Psychotogical da^radatlon of puplli through verbal attack, 
critlclam. or aarcaam. 



Critical and Irralavant ittributaa of th« cofiCtpl of 
•mpathio control, baaod on Fink and 8ommal (1071). 

Critical attributH of ampathio control 

1. An act of teacher* 

2. Ipltlatad by ptipil mirbehavlor* 
9, Mlabehavlor it not critlcliad. 

4. Expraaaiona of undaratanding pupira feelings 

5. Relating pupira behavior to hia feetlnga. 

Irrelevant attrlbutaa of ampathio control, 
t Empathlc control can be Initiated by any type of 
pupil mlabehavtor. ' 

2. Statamente be made to an Indh^ldual pupil or to 
a group of pgplla. 

3. Statementa may or may not be accompanied by 
raaiaurino phyaical contact. 

4. Language of the empathic statementa may vary 
considerably. 
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Figure 13 

Hierarchy ol concepts related to teacher behavior, 
based on Fink and Semmei (197t). 




Chapter6 

Spoeifying inatruetional objectivoi 



Objectives 

1. Define a behavioral objecllve In terms of Its com- 
ponenls, and give a ratlonala for use of behavioral 
objectives In Instructional development. 

2. Convert the outcomes of a task analysis into a 
set of behavioral objectives. 

3. Convert the outcomes of concept analysis Into 
behavioral objectives. 



The specification of instructional objectives is the 
transformation of task and concept analyses into 
statements of goals for instructional material. A|- 
though the debate continues on the **best*' type of 
objectives, there is general consensus that the most 
useful behavioral objectives for instructional develop- 
ment and evaluation are those that specify the desired 
terminal behavior of the trainee. 



Why ipectfyobleotivei? 



Objectives form the basis for both the design and 
evaluation of instructional materials. In sequence, 
they provide an outline of the material, Develop- 
mental time and resource allotments may be made 
according to the number of objectives and the relative 
complexity of each. The nature of the objectives is 
also one of the most Important factors in the selection 
of instructional media and format; in the actual 
design of the material, objectives provide corrobor^ 
ation of the relevance of Instructional content and 
activities. 

A set of objectives arranged In a suitable sequence 
becomes the most Important component of the in- 
structional package. In one instructional format, the 
teacher trainee Is merely provided with such a set 
of objectives and entrust^ with the responsibility of 
attaining them. In a/;other effective format, objectives 
are keyed to a variety of existing textbooks, articles, 
and other alternative resources. Objectives foi a the 
basis for the construction of a criterion test which, 
in turn» provides for quality control during develop- 
ment of the instructional materials. Objectives arc 
also useful during the dissemination of instructional 
materials. By scanning them, a potential user can 
decide whether or how much they coincide with his 
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goals. During actual use of the materials, objectives 
serve as self*evaluation checklists to facilitate the 
teacher trainee's learning. Oels (1972) pointed out 
another very beneficial but often overlooked effect 
of objectives on the person who specifies them. The 
process of specification produces new Insights and 
attitudes (including increased humility about goals), 
refocus of attention on the learner, re-examination 
of the contribution of instruction, and clarification of 
the relation between Instructional objectives and 
societal requirements. 



How to convort task analysts Into behavioral 
ob|scttves 



Objectives are not created hapha?ardly; they are 
derived from an analysis of the instructional task or 
concept. When the task analysis and/or concept 
analysis is completed, the process of specifying 
objectives may be viewed as an attempt to communi- 
cate unambiguously the instructional intent of the 
material to its potential users, **How-to*' books on 
writing behavioral objectives are given in the biblio- 
graphy at the end of this chapter. The following five- 
step process (Thiagarajan, 1 97 1) uses three examples 
based on the task analyses presented in Chapter 4 to 
show how behavioral objectives can be derived 
systematically. 



Step U Specify teaclier trainee's terminal behavior 
or the results lie Is to produce. 

Statements of objectives in termi of content (e.g., 
'^parental involvement*^) or what the instructional 
material does (e.g., "This module teaches you how 



to select a suitable reader for an educable mentally 
retarded pupil") do not convey expected Instruc- 
tional outcomes. The most essential component of 
a behavioral objective is the specification of the 
terminal behavior which is expect6d of the teacher 
trainee as a result of the instruction. Here are some 
examples of objectives in which the behavioral terms 
arc emphasized. 

The teacher trainee ehall /o«c^ a camera. , . , 

The teacher trainee $h&H acfm/n/^^er an Ififormaf 
textbook test to an educable mentally retarded 
(EMR) child . 

The teacher trainee shall mlt0 a specific lesson 
plan for use by parents, ... 

In the last objective, we are obviously not interested 
in the actual behavior of writing (i.e.^ the process of 
holding a pen and forming letters and words) but in 
the outcome of the writing. In this sense, the term 
''behavioral objectives'' is misleading because we may 
be interested in either the behavior or its outcome. 



Step 2» Indicate the range of situations under 
which the teacher trainee is expecli J to perform. 

Although the objectives are now fairly specific, 
we do not know the range of the expected perform- 
ance, in the first example, is the learner to load an 
instamatic camera, a movie camera, or some other 
type of camera? By incUtding a statement on the kind 
of camera— the range for the expected performance 
—the objective is made specific. Look at the third 
example: Is the teacher trainee expected to come up 
with lesson plans on any topic or only on topics of 
his choice? Again, the statement about the range for 
the expected performance makes the objectives more 
specific. 
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The teacher trainee ahall load any $t$nd$rd OSmm 
camera.... 

The teacher trainee ahatl administer an informal 
textbook testto art EMR child. . . . 

The teacher trainee ihall write a specific lesson plan 
on $ topic of hl$ c^o/ce for use by parents. . . . 



Step 3« SpHlfy reference materials* aids» and 
equipment which the teacher trainee may or may 
not use. 

When the teacher trainee loadfi the camera, can he 
iise the instruction manual which came with the 
camera? Can he refer to a checklist while adminis- 
tering the informal textbook test? Can he use cur- 
riculum guides and textbooks while preparing his 
lesson plan? Answers to these questions make the 
objectives more specific. 

The teacher trainee shall load a . . . ;amera wiVu>u* 
any re/erences. 

The teacher trainee shall administer the tnformal 
textbook test . . « without the u$$ of any proeedUfat 
gufdaiinea. 

The teacher trainee shall write a specific i^^ason plan. 
... He wlllhavB frea access to curriculum matarlats 
andguidas. 



Step 4« Indicate the standards for acceptable 
performance by the teacher trainee and for his 
products. 

Do we want the camera to be ready for shooting 
pictures? What procedures should the trainee follow 
during the administration of the test? How detailed 
should lesson plans be? The answers to these ques- 
tions provide the standards for our objectives. 



. . . When loaded, th^dlm should beprcperly advanced 
to the first frame and the camera ready /or use. 

. . . tn administering the test» the teacher trainee 
should follow this procedure: 

1. Find the highest grade level Uom the child's 
records. 

2. Choose basal reader at this level. 

3. Choose two 100-word passages for reading. 

4. Introduce the story (0 the child. 
6. Ask child 10 read afoud. 

e. Count number of amra made by the child. 

. . , The (inii version of the lesson plan should contain 
(a) a set ol objectives tor the child to attain, (b) a 
set of questions to be asked by the parent, (c) a list 
of equipment needed, (d) a list of words to be 
emphasl2ed» and (e) a suggested schedule of 
activities. 



Step $• Speciiy a time limit within which the teach* 
er trainee Is to perform or complete his product 



Here are some sample time limits: 

The teacher trainee shall load the camera . . ,wlthln 
two minutas. 

The teacher trainee shall administer an Informal 
textbook test ... wilhfn a parfcd of 90 mlnutas. 

The tctacher trainee shall write a lesson plan . . . 
within a wash's tima. 

In summary, th^ essential components of behav- 
ioral objectives are the specification of 
* . . a performance or product. 
. ♦ . the performance range. 
. * , the performance conditions. 
. . . standards for the performance or product. 
. . . time limits, if appropriate. 



Here are the completed statements of our three 
iliustrdtive objectives: 

The I0«ch»r trainee ihall load any standard 35mm 
camera with a standard roll of lilm within two minutes, 
without using any referencas. When loaded, the film 
Should ba properly advancad to the first frame and 
(he camera ready for use. 

The teacher trainee shall admlntstar An Informal 
textbook test to an EMR child, without usln{| any 
procedural guidelines and within a period of 30 
mtnutea. He will be provided ^Ith the child's records 
and a variety of readers. In administering the test, 
the teacher trainee should foUOw this procedure: 

1. Find the highest grade level from the child*a 
records. 

2. Choose basal reader at this level. 

3. Choo^ two 100-word passages for reading. 

4. Introduce the story to the child. 
Ask child to read aloud. 

t. Count number of errors made by the child. 

Using any curriculum materials and guides, the 
teacher trainee shall prepare a specific lesson plan 
for use by parents In helping their cliltdren. The lesson 
plan may be on any topic. The final version should 
be produced within a week's time and should contain 
the following: 

1. A set of obfectivea. 

2. A set of questions to be asked by the parent. 

3. A list of words to b$ dmph&slied. 

4. A list Of Oquipment. 

5. A suggested schedule of activities. 

Beyond trivial objectives 



Behavioral objectives very often turn cut to be 
mechanical and trivial because the first set of be- 
havioral t^rms which come to mind are frequently 
simplistic (e.g., •label," "llsl,^' "stale," and "select"). 
Hov,5Ver, other behavioral terms, such as "evaluate," 
"juMify»" "rede&Ign," and **compare and contrast," 
may be identified through a longer search and used 
appropriately. A number of books and articles 



(Oronlund, 1970; Metfcssel, Michael, & KIrsner, 
1969; Vargas, 1972) contain lists of suitable be- 
havioral terms associated with higher-level learning 
tasks* 

An example follows of how to convert an analysis 
of a concept (Chapter 5) Into nontrlvlal behavioral 
objectives through the five-step process. 



How (Q convert concept analym Into behavioral 
ob]ecllve» 



Step 1* Specify teacher trainee*! terminal behavior 
or the products he Is to produce* 

In the case of conceptual learning, the teacher 
trainee should be able to perform behaviora which 
are most often related to the mastery of a concept: 

To define the concept* 

To label different examples of the Concept, 

To generate new examples of the concept. 
The behavior of labeling different examples (e.g., of 
student off-task behavior) or generating differert 
examples (e.g., of empathic statements) is more rele- 
vant to a teacher trainee than that of reciting verbal 
definitions. Depending upon the nature of the 
Instructional material, either or both terms can be 
used in the objective. Here is a sample objective: 

The teacher trainee shali correctly labei aii given 
examples of pupil physical aogreseloa . . * 

Step 2« Indicate the range of situations under 
whkh the teacher trainee Is expected to perfoim, 

If the teacher trainee is supplied only with examples 
of physical aggression and asked to label them, then 
we are merely measuring his ability to generalize. 
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Real understanding of the concept also requires that 
the trainee be able to discriminate, that is, not label 
nonexamplesof phy&kai aggression. Hence the situ- 
ation under which the trainee Is to perform should 
Include both examples and nonexamples of the 
concept. If the examples are the same as those used 
during instruction, the tralnee*s labeling behavior 
may Indicate not mastery of the concept but a good 
memory. Hence the type of examples presented to 
him should be new ones. Similarly, the nonexamples 
used In the testing situation should not be obvious. 
Friendly behavior is so different from physical 
aggression that it is not a good test of fine discrimt- 
nation* On the other hand, examples of verbal 
aggression or physical resistance share attributes 
with physical aggression, and discriminations among 
them indicate a higher level of understanding of the 
concept The teacher trainee should be given such 
close-in nonexamples to test his ability to discriminate. 

Another aspect of the range Is the media for pre- 
senting examples and nonexamples. Whether the 
teacher trainee is to label pupti behaviors in an actual 
classroom or on video tape segments makes a dif- 
ference in his level of performance. Here is the 
expanded version of the same objective with a 
specification of the range: 

The toacher trainee shall be shown video tape 
segments of pupil behavior. Rimdomtyocciirrino \n 
these seomenti w))l be new examples of physical 
aggression and other behavior, such as verbal 
aggression and physical resistance. The teacher 
trainee shall label all examples of physical aggression 
correctly^ 



Step J. Specify reference materialsi alds^ and 
equipment which the teacher trainee may or fsn$y 
not use« 

The nature of a concept-labeling task changes 
considerably depending on whether the trainee is 
permitted to refer to the definition of the concept. 
Whether to deny access to the definition depends pri- 
marily on the situation to which the mastery of the 
concept ts (0 be transferred. An administrator who 
must classify a child Into a specific legal category 
may need to refer to definitions and the objective 
may reflect this need, 

Using the definitions of different handicapplno 
conditions found on page 7, the trainee shall classify 
each of the ten children for whem detailed date is 
available. 

Usually, however, a trainee Is required to classify 
children*s behaviors rapidly— a situation that does 
not permit the leisurely use of definitions. Hencei In 
the case of labeling examples f f physical aggression, 
access to all reference materials should be denied. 
This provision could be incorporated into the 
objective thusly; 

Without using any reference materials, the teacher 
trainee shall label.... 



Step 4. Indicate the standards for acceptable 
performance by the trainee* 

As discussed earlier, mastery of the concept re- 
quires that the teacher trainee be able to do two 
things: 

Generalize to new examples by supplying ihem 
with the label. 

Discriminate nonexamples by not supplying them 
with the label. The performance standard for the 



objective now may be slated as follows: 

The toach0r trainee should label all positive examples 
with the t^rm '*phyflcal eayre^i/on/' He should not 
apply the aarni^ label to other behaviors. 



Step 5. Specify a time limit within which the 
teacher Iraiitee is to perfiorm. 

Once again the time limit is to be used only if 
appropriate. For the last objective, it may be staled 
as follows: 

The teacher trainee will r>ot be permitted to replay 
the video tape. Hence his labeling performance should 
be undertaker) within the time provided In the 
seflment. 

The statement of the objective is now complete. 

The teacher trainee shall be shown video tape 
aeomertta of pupil behaviors. Ra^'domly occurring In 
these segmer^is will be new examples of physical 
aggression along with similar behaviors, such as 
verbal aggression and physical resistance. Without 
using any reference materials, the teacher trainee 
shall label all positive examples of physical aggres- 
sion and shall not apply the same label to any other 
behavior. The teacher trainee will net be permitted to 
replay the video tape and hence should work within 
the time provided by the segments. 



become the standards for the traltiees* products. In 
some other situations, we may want the trainee's 
performance to fall Into a specific concept category* 
In such a case^ the following example illustrates how 
concept analysis Is converted into a specific objective: 

Terminal The teacher trainee shall use appro^ 
behavior: prlate empathio controls « . . 

Performance . . . during an actual teaching situation 
range: In a classroom ... 

Performance 

conditions: . « . without any help or prompts. 

Standards 1 . Empathio controls should be used 
for with at least half of the disruptive 

acceptable behaviors by pupils, 

performance: 2. Empathio controls should fmmedl* 
ately follow a disruptive behavior. 

3. The teacher should express his 
understanding of the pupirs feelings. 

4. The teacher should relate the 
child's feelings to his behavior. 

5. The teacher should not criticize 
the child's behavior. 

Time limit: None specified, 



ConcepHeneralton objectlvaa 



Earlier, we discussed a type of objective resulting 
from concept analysis which requires the trainee to 
generate products or performances that fall into a 
specific concept category* For example^ in the 
objectives "write a lesson plan" or "prepare an 
experience chart/' the critical attributes of the con- 
cepts "lesson plans'* and "experience charts" 
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illl«d«dblblhHir*phyo(i 



Reprinted by permlMlon; Qels, 0. 1., Behavioral 
obJactN0$i A ld/ect0d bibliography A brief review. 
Stanford: ERtO Clearinghouse on Media and Tech* 
nolofly, 1972. 

Armilror^, R. J.. Cornell; T. 0., Kraner, fi. E.» A 
Rob^rion, 6, W. Th$ develofimeni and evaluatlor\ 
otb$hivhral obj$ollve$. Worlhlnglon. Ohio: 
CharlesA. Jones, 1970< 

A brief, oanoral discussion of objectives Is 
followed by a chapter on behavioral objectives 
which Is aimed at teaching the reader how to 
critique and write objectives* Luter chapters deal 
with measurement of behavior and Incorporating 
objectives Into the evaluation procdss. Nine sell* 
tests ara included. The authors suggest that the 
book would be useful to admtnlstrators and 
teachers at all levels of education and could be 
used as a text In teacher*lralnlng prograr^is. 

Burns, R. Mew approaches to behavio al ob- 
/acr/ve^« Dubuque, Iowa: William 0. Brown, 1d72. 

This book ''deals extensively with the objectives 
for Instructional settings— their selection, creation, 
writing, evaluation and use/' Exercises and self* 
check evaluations are Incorporated In the book. 
''Special attention has been given to affective 
objectives/' The author provides discrimination 
training for the reader on several critical points 
(e.g., goals versus objectives, terminal behavior 
objective vorsus instructional objective)* The 
examples are drav^r) from academic disciplines. 



Cohen, A. M. Objeotlvas tor collage courses. Beverly 
Hills: Qlencoe, 1970. 

This book Includes a programed lesson (n ob^ 
jectivee writing as well as chapters on: Definitions 
of Terms, Qoals and Objectives In Sequence, 
Implications of the Process, and Criticisms and 
Caveats. One chapter presents In detail about 
100 specimen objectives for various college 
courses. Appendices Iriciude checklists and a 
bibliography of artlctes on behavioral objectives. 

Oronlund, N. E. SfatMg be/iav/ord/ o5/ecf/va47dr 
classroom hstructlort. N Y.; Macmltlan, 1070. 

The author explains how to state objectlvos In 
behavioral terms and suggests where to get Ideas 
for instructional objectives. Addltlpr^al sug* 
gestiona are made concerning how the Instructor 
might use behavioral objectives In measuring 
student performance. Based on Bloom's taxonomy, 
the book is aimed primarily at elementary and 
secondary school teachers. 

Kibier, R. J., Barker, L L.» & Miles, 0. T. Behavioral 
objectives ar^d Instruction. Boston: Allyn and 
Bacon, 1970. 

This book discu'ises the different types of edu* 
cational objectives, controversial Issues regard- 
ing behavlo.'V objectives, the general model of 
instruction, ("ow to plan objectives, how to write 
InformMtoiial objectives and the Influence of 
behavioral objectives In education. Samples 
of behavioral objectives are given. 
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Magor, R. F. Pr$parlng Instmtlonal obl$ctlv$$. 
Belmont. Calif.: Pearon. 1962. 

This proQfanr^med book Is concerned with de- 
signing usefully staled objectives rather than 
with belecting them. It Is by now the classlo book 
on how to write Instructional objectives. 

Mag&r, F. Ooal analysIs^ Belrrwnt, Calif.: Fearon. 
1972. 

This is a short, breezy text with numerous setf< 
checking and performance posttests. The text 
alms specifically at teaching the reader how to 
clarify 'fu22/' goal statements, especially in the 
area of affective objectives. Upon completion of 
the book the reader should be able "to Identify 
statements that describe abstractions and those 
that describe your meanlrig of the goal/' The 
examples deal with objectives that are quite 
varied, e.fl.» "love of learning," "pride In work.** 
The text, while easy to read and humorous, 
covers many crucial Issues In goal analysis. 

McAshan, H. H. Writing behavioral objectives: A new 
approach. N.Y.: Harper & Row. 1070. 

Each chapter In this paperback text provides a 
check-test at the beginning. No background In 
teaching, curriculum development or objective 
writing Is assumed. It Is designed to be used 
individually or In a workshop. Chapters Include: 
Behavioral Objective Components, Developing 
Ooal Statements, Identification of Evaluation 
Activities. Completing the Writing Process. Unique 
Writing Problems and Guidelines for Writing 
Objectives. 



Popham, W. J.. & Baker, E. L. EetabllsMng /rtSfrucf- 
lonal goals. Englewood Cliffs: Prentlce-Hall, 1070. 

This book consists of five self-Instructional pro« 
grams which focus on Instructional goals: how 
to select them, how to state them» and how to 
establish pupil perf orrnance standards for such 
goals. 

Vargas, J. S. Writing worthwhile behavioral objec- 
f/ves. N.Y.: Harper & Row J 072. 

This self^lnstructlonal text attempts to teach "the 
fundamentals of writing (cognitive) objectives 
and discusses what should be taught end why.'' 
It also Includes discussions of understanding, 
concept formation and creativity. Bloom's tax^ 
onomy serves as an organizing system. Examples 
are drawn from a variety of disciplines and grade 
levels. Pretests, exercises, eto. are Included. 

Yelon, S. L, & Scott, R. 0. A strategy tor writing 
objectives. Dubuque, Iowa: Kendall-Hunt, 1970. 

This programed text Is designed to help teachers 
write behavioral objectives and to select appro* 
ptHe tests, ft is addressed to the problem of 
writing objectives for college level Instruction as 
well as for lower levels. A variety of uses of In^ 
structlonal objectives are suggested. 



Chapltrr 

Conilruotion of erlttrion^ 



Objectlvet 

1. Explain what Is a crlterlon-reterenced test and 
how it differs from a typical norm-relerenced 
test. 

2. ?:xpialn the relation between criterion-referenced 
test construction and other ar>pectsot Instructional 
development. 

3. Given an Instructional objective, design one of 
these three types of crlterlon^referenced testing 
situations: (a) paper*and^pencil. (b) performance 
under simulated conditions, and (c) performance 
under natural conditions. 

4. Prepare checklists and rating scales for use in 
performance test situations. 



A criterion-referenced test measures the teacher 
trainee's attainment of instructional objectives. Its 
construction may be viewed as the process of oper- 
ationallztng behavioral objectives. Items in criterion- 
referenced tests are based strictly on instructional 
objectives, and scoring is based on the standards 
specified for each objective. 



Why oonttruct crlt6rlon*r6(tr«rH:#d tetU? 



Quality control of hsfruclloiuil materials/ A 

criterion-referenced test can be used to check the 
effectiveness of instructional materlaK During for- 
mative evaluation, the test enables the developer to 
locate sections of the materials which need modlH- 
cation* During summbtive evaluation^ the same test 
is used to demonstrate the effect Iveness of the 
material 

Measurement of teacher tralnee*s achlevment. 

In actual classroom use a criterion-referenced test 
measures the degree to which the trainee has attained 
the instructional objectives, The trainer may use the 
test before instruction to check whether a particular 
trainee requires training, assign different trainees to 
different entry points of Instruction, and suggest 
skipping certain sections of instructional material 
Afier instruction, the test may be used for computing 
the gains in the trainee's achievement and to suggest 
remedial activities, if they are required. Oj^rZ/i^ 
instruction, the trainee may use the criterion-refer* 
enced test to check his progress. 



When to conttruci (etit 



We suggest thai criterion-referenced tests be con* 
structcd even before the design of instructional 
material, for four reasons: 

1 , Criterion-test items make the objectives more 
specific. The construction of the test is» therefore, a 
logical extension of specifying objectives, 

2, By constructing the test first, the developer can 
consciously avoid using the same items and examples 
in the instruction exercises. 

3, Criierlort-referenccd test items provide an outline 
for the instructional material Borrowing a technique 
from programed instruction, the developer can 



arrange test items in a logical sequence of difficulty 
and then he can design corresponding sequences of 
instruction. For example, the first section of in* 
struction would begin with the target trainees* entry 
level and cover the skills and knowledge necessary 
for them to respond correctly to the first question; 
the second section would bridge the gap between 
that level of performance and the level necessary for 
correct responses to the second question; and this 
procedure would be repeated until enough sections 
of the material had been covered to enable the 
teacher trainees to respond correctly to all the criter* 
ion-test items. The procedure of using built-in 
criterion items as guldeposts in Instruction Is Illus- 
trated !n Figure 7»1» 
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Figure 7.1 

Relationship between cmerion-referenced test items 
and teaching sections of the instructional material. 
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4. In some instances, a set of equivalent criterion^ 
referenced tests may be all that is required for 
Instructional purposes. A number of resource- 
management formats, described in Chapters 10 and 
1 1 , use criterlon«referenced tests to help the developer 
select, evaluate, annotate, and organize existing 
instructional resources of various types. 

Entry tests 

A special type of criterion-referenced test Is the 
entry test; it is based upon the specincation of pre- 
requisite skills and knowledge. The entry test de- 
termines whether a trainee Is ready to benefit from 
the instructional material. It can be used also to 
diagnose deficien !c$ and prescribe suitable remedial 
instruction. 



Three levels of criterion-referenced testing 



The best test of the trainee's acquisition of new 
skills and concepts is actual performance under 
natural conditions. Unfortunately^ actual conditions 
arc often contaminated by random factors and ad- 
ministrative problems. Thus, performance under 
simulated conditions is advisable. It permits 
standardizing the situation to a large extent and, 
therefore, increasing the reliability of the test. 
Another alternative is a papcr-and-pencil test. These 
three levels of testing in relation to the same ob* 
jective are Illustrated in the following example of a 
test accompanying a set of materials on disruptive 
behavior; 



Three levels of crHerlon* referenced teitlng of the 
meitery of the concept of $ggr0$ilon. (Bated on 
Fink & Semmel, 1971) 

Objective: 

Correctly Identify examples of agresslve behavior. 
P«per-and*pencitteit: 

Label each of the folfowlrv^ examptes va (verbal ao^rev- 
eion) or pa (phyeical aggression). Leave blank If It Is not 
an example of aggreselon. 



A. 



B. 



C. 



0. 



Pupil: Slams ruler across another pupil's 
knuckles. 

Pupil: Draws a circle on the back of his 

neighbor's shirt with ball-point pen. 

Teacher: Walking down aisle to help pupil In 
back row. 

Pupit: Sticks out foot and trips the teacher. 

Teacher: ''Put those crayons away.** 
Pupil: "You're a stupid so-and-$oi" 



C. Teacher; "John, why aren't you doing yoor 

assignment?" 
Pupil: "I don't understand the assignment.** 

Performance teit under ilmulated condltlona: 

Teacher trainee Is shown a four^mlnute video tape seg< 
ment of a classroom protocol. At various Infervafs a "beep" 
sound Is heard. The trainee Is to mark down on a special 
answer sheet whether the behavior of a particular child 
at that specific point In time is physically or verbally 
aggressive. 

Performance teat under natural condltlona: 

After a regular teaching period, the trainee recalls different 
occurrences of physical and verbal aggression during that 
period. His listing Is compared with the on^ made by his 
supervising teacher observing the same class during the 
svne period. 
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The following is anoiher wample of a criterion- 
referencfd testing situation, also at three levels, this 
time from a training material dealing with lesson- 
planning skitU for parents. 

ThrM itvtU of <^rtt0rl«n*r#ftrtno#d tHtino of th# 
ikill of prfparing ipoolflo itMon plini for m by 
puronli. 

Obltotlvor 

fj^*i?-i ^^^^ P'«n tor m by parenti In helpiho 

their EMh children. 

PipoMMl^Pf ncll ttifj 

Lift the eieentf il eompo^iente of a leeeon pfan for use 
by parents. 

Performineo feit undt r elmulit«d oondittomt 

William T. 1$ an EMR child with a CA of U t His (ateit IQ 
Is 1i; reidino level. 2.9; arlthmelfo Qrade, H: and orade 
expectancy, 4. 

Wliliam'e mother la a housewife with an underoraduate 
(looree. 

Prepare a specMro teeeon plan for use by William's mother 
to help her child. The lesson plan may be on any topic. 
VoM may use any currlpMlum materials and guides. 

The finished lesson plan is due on or before December 6th. 

Pert ormnnot leit under natural condltlont: 

As a part of their Job, special class teachers In the Roose- 
velt School are r^uit^d to prepare ten lesson plans for 
parents during the course of each school year 

Testing consists of obtainfno and evaluating three randomly 
chosen tesson plans for each teacher. 



Designing a Written test 

The primary rule In writing a criterion-referenced 
item is to measure directly and validly the behavioral 
objective. Compare this objective? 

The teecNr trainee ihati (fat five critical oomponents of a 
specific lesson ptan for use by parents ol exceptional 
children. 

with this test item: 

Lesson ptana for parents Increase the teacher's eff ectlve- 
nesa b*^autii ' 

The last Item measures the ability of the trainee to 
give a rMlpnale for le$sort plans for parents, It is 
Irrelevant to the objective, which calU for the ability 
to ll« components of a leason plan, arid hence h not 
criterion-referenced. Now look at the following test 
item: 

All epeciflo (oMon ptani for tiie by parents should contain: 

a. asetofobjectivee 

b. a set of queetloni to be asked by the pareni 
0. a iistofwordiiobeemphaiiied 

d* all of the above 
e. none of theabovf 

This item Is definitely relevant to th0 objective. 
Howeveti the performance requtrt^ by the item 
{rtcognUion of component* of a le$$on plan) Is not 
the same as the performance specified in the objective 
{Hsiing of compon^^nts of a lesson plan), Hence the 
item Is not criterion-referenced. The most valid Item, 
of course, will be a restatement of the objective, thus: 

List five critical components of a specific lesson plan for 
use by parents of exceptional children. 

Most classroom tests use the multiple-choice for- 
mat because of reliability and ease of scoring. 
However, In criterlon-referenced tests the type bf 
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Item 1$ dclcrmlficd solely by the nature of the ob- 
jective. A multiple-choice item Is used only when 
the objective calls upon the trainee to choose some- 
thing* tn most other cases, constructed responses and 
short-essay answers should be required. General 
guidelines for writing test items will be found in any 
standard test-construction manual. A selected set 
of these texts are listed In the bibliography at the end 
of this chapter. 

Designljig i perfonnaiKe test under simulated 
conditions 

In some respects, simulated conditions are superior 
, to natural on^ because it Is possible to control and 
standardise them* For examplei let us assume that 
We are testing the ability of teacher trainees to use 
specific teaching skills. Under a simulated situation 
we could give the same lesson topic to different 
teacher trainees. This standard lesson could be on a 
novel or even an artif]k:ial topic (although repre- 
sentative of the special education curriculum) so 
that the trainees' previous knowledge and experi- 
ence would not enter into the picture. For example, 
the trainee could be asked to teach an Imaginary 
class or a group of his peers In a micro-teaching 
situation. 

A trainee*s ability tn a performance test may be 
evaluated by looking at either the procedure or the 
product. Sometimes we may have to evaluate both, 
but it is easier to evaluate the product since ft per- 
mits leisurely inspection. Evaluating an actual 
performance as it occurs requires reliably trained 
observers. This task could be simplified by capturing 
the tralnee*s performance on video tape and review- 
ing it repeatedly. 

An evaluation checklist or a rating scale should be 
employed in a simulated situation, regardless of 

O 
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whether a procedure or product is being evaluated. 
The items in these Instruments should be based on 
the performance standards specified In the instruc- 
tional objective. A sample of a rating scale for 
product evaluation 1$ shown below* Ihe product in 
this example Is a set of teacher-prepared lesson plans 
for use by parents, - 

A ratino icalt of taieh«r*prap«r«d Itiapn plana for 
uaabyparanla. 

Dlrecttons; Rate each Item on the basts of 0 point* for 
OMlstandlng quality* 4 points for batter 
than avarada. 3 ppinta for avaraae, i 
polnta for balow avaraaa, and i for un- 
aocaptabla. Circiatha approprlata number 
to indloata your ratino. 



1. 


Set of Ot>]M(IVM 


1 


2 


3 


4 


6 


2, 


Number ol quM<lon» 


1 


2 


3 


4 


6 


3. 


typed ol quMtlont 


1 


2 


3 


4 


6 


4. 


Word litt 


1 


2 


3 


4 


6 


5. 


List o( oqutpmofti 


1 


2 


3 


4 


ft 


6. 


Ohotco of equipment 


1 


2 


3 


4 


5 


r. 


Sugfletted eehedule of aciNltlet 


1 


2 


3 


4 


ft 


9. 


Approprlatenete of •ellvltiee to the 














child 


1 


2 


3 


4 


ft 


0. 


Quatlly and finish 


\ 


2 


3 


4 


ft 


10. 


Time requirement 


1 


2 


3 


4 


ft 



An example ot a checklist for evaluation of an In- 
structional procedure (administering an informal 
reading test) follows. More details on the con- 
struction of such Instruments may be obtained fmm 
appropriate texts listed in the bibliography at the 
end of this chapten 
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Bviluiitloii 01 IrilMi^i tdmlnlttratlon of in Informal 
rf Milnfl l##t. 

Olr0OtlOhi: Ai tioh t^iohar tralnao admlntattri the 
\f\f6tm\ riadtoo t«il, ot^i^rva m pro- 
cadur^ ind ptac« l on^ck In the blank 
pra«<MIKno #lM>h itap whfeh ha f alli to usa 
ofMiMoutofiaciuaoi^. 

1 . ^ — . Ha tha htobaat orada laval ffom lha 
ohiwaraoordi. 

2.. , Haoh0oi#it>a#airaadafatthalavalottha 

hlghait^rada. 

3. Hf ohooiaa ona 100-word paiaaga from tha 
bajinhlnoof thabook* 

4 Ha ohooiaa afiothar 100-word paaaaga from 

thamlddfaofthabook. 

6. Ha aatabltihaa rapport with tha <ih)M. 

a Ha Introducai tha »(ory to tha child. 

7 . Ha atka tha phtld to raad aloud, 

e. Ha racotda arrori aa tha child makaa tham. 

9. ....-^ Ha atopi tha child at tha ar)d of tha paaaaga 
or whan mora than f Iva arrori ara mada. 

10 ^ Ha quickly addi up tha total humbar of arrori. 

1i ^..^ Ha raadmlntitara tha (ail ii|ln9 anothar book 
If nacanary. 

12...^ Ha takaath« child back to hlaclaMroorvi. 

In the case of concept tnmtty testing, the slmu- 
hated situation can Include the showing of d film or 
video tape segment that contains exampjes and 
n^^ncxamplesof the relevant concepts. Expert judges 
go through the segment beforehand and come up 
with a model analysis of the materiak The trainee's 
analysis is then compared to that of the experts, 



Performance teita undemahiral condltlona 

Although natural situations do not permit much 
control over performance conditions, they provide 
the most valid test^ of the trainee's ability to im^er 
his ikills to actual working condltloni 

Perfof mance testing under natural conditions offers 
the option of Informing or not Informing the trainee 
that he Is being observed. Each approach has 
strengths and problems. Procedures for evaluating 
the trainee's performance are very similar to those 
described for simulated conditions, In addition to 
checklists and rating scalef, observation systems that 
focus upon a few selected aspects of behftvlor are 
also very useful For details of the constructlpn and ' 
use of obs*rvatlon systems, refer to Flinders (1970), 
Roberson(l91I), and Simon and Boyer (1970). 
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Media teltotion 



ObJecUv«t 

1 . Justify (he use of different media in preparing 
teacher-tralning materials. 

2. Define the following medfa attributes and explain 
their roles in suitable media selection: color, 
three dimensionality/motion, pacing, random 
access, sensory mode, and sign type. 

3. List basic facts and attributes of the following 
media: audio tape, print, slide, overhead trans- 
parency, film, and video tape. 

4. Giverii Information from learner, task, and concept 
analyses, setoci the optimum media by match- 
ing essential attributes. 

5. Make final media selection on the basis of local 
production and distribution considerations. 

6. Locate suitable reference materials on the pro- 
duction of different types of media. 



The term ••media** means dlfferenl things to different 
people. In its broadest sense, it denotes any means 
of transmitting information. Current u$ag« of the 
term incorporates both the content (software) and 
the materials aiid equipment (hardware). Thus» the 
term "film media" can refer to the photographic film 
(material), the projector (equipment), or the in- 
structional messai^e on the film (content), 

Not all media are of equal Importance in the 
preparation of teacher^tralnlng materials. The media 
In the following list are potentially useful, however. 

1. audio tapes 4. real objects 7. overh^^ad trans- 
i. print 5. fllmstrips parci^cles 
3. models 6. slides 8. motion pictures 

9. videotapes 



Whymodia? 



Media can play an important role In iht training 
of teachers of exceptional children because they per* 
mit us to preserve, edit, anddistriWe instructional 
information. 

Certain media enable us to capture events as they 
happen^ to store them, and to use them at a later 
time. For example^ with motion picture cameras and 
video tape and audio tape recorders, we can capture 
the events in a given classroom at a particular time 
and reproduce them for leisurely inspection at a 
later time as often as W0 like. Special classroom 
protocols can be studied by the teacher trainee until 
he has acquired all the contained information. Pre- 
serving an instructional event not only makes it 
available for future use but permits its use as a 
standardized and replicatable base for testing. 

By carefully editing a film or tape, we gain a high 



degree of $llmutu$ comtx)!. We can selectively focus 
the camera, cut out Irrelevant distractions, or even 
rearrange the sequence of activities. For example, in 
training teachers to discriminate different levels of 
classroom questions, we can record all teacher talk In 
an actual classroom and later edit out everything 
except the questions, We can also rearrange the 
sequence of the questions to form categories. We can 
record the changes in an emotionally disturbed child's 
behavior over a period of a year and then edit out 
alt but the highlights for a ten-minute film. 

The danger Inherent In the power of media is the 
temptation to edit out anything that does not fall 
within a freconcelved framework. With too much 
editing, the material may turn out to be a simplified 
but highly distorted version of reality. 

Just as the preservation property of media enables 
an Instructional event to travel through time, so the 
distributive property enables it to travel through 
space. Thus, by viewing a film, a teacher trainee in 
Indiana can take an armchair field trip to a special 
elassfoom in Texas or to hundreds of other geo- 
graphically dispersed locations for demonstrations 
of specialized teaching techniques. The film also can 
be said to multiply the number of master teachers 
available for training. 



Aspects of msdia selection 



For a long time media specialists have been asking. 
"Which medium is best suited to portray realistically 
my instructional content?** 

Although realism is very desirable in some situ- 
ations (e.g., a criterion test), there is no evidence 
that it is desirable or even necessary during the in- 
troductory stages of instruction. Actually, a number 



of studies suggest that too much realism makes learn- 
ing difficult, Consequently, the question h^s been 
changed to *'WhIch medium Is best suited to help my 
trainees attain my Instructional objectives?'* Study 
after study has shown no signiflciant differences 
among media. This seemingly surprising result Is 
mainly due to the vagueness of the question, For 
example, when we ask ourselves whether a film, 
book, or lecture is best suited for teaching some skill, 
we are using ambiguous terms. When a film shows 
only the face of a professor talking, it closely re- 
sembles a traditional lecture; wheii It projects printed 
words. It becomes an expensive page turner. On the 
other hand, film permits the use of such effective 
techniques as time-lapse photography, slow motion, 
color, split screen, and stereop^ojiic sound; Hence, 
the real question Is not Which medlumr but ''Which 
media auribuiesr 

Media attributes refer to variables such as motion, 
color, and dimensionality. Film and video tape, for 
example, share the attribute of showing motion. The 
media selection question now becomes, **Whai at- 
tributes will help my students attain the instructional 
objectives?" This question involves matching the 
entry characteristics of learners, requirements of the 
task, and critical attributes of the concepts to the 
attributes of media. Once the desired media attributes 
are listed, we can Identify the medium (or com- 
bination of media) that has these capabilities. We 
can then narrow our choice through consideration of 
production and distribution Issues. 

Table 8.1 compares the media listed previously oi^ 
seven attributes, which are then discussed In order. 

Color. Real objects, color photographs, slides, and 
color film are some of the media that share the 
attribute of portraying color. Although only a few 
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specialized (eacheMraining topics (e.g^ art therapy 
for emotionally disturbed children) require the use of 
color, most teacher trainees prefer color over black 
and while* perhaps because the motivational effect- 
iveness of the material is enhanced. 

Tbm dlittenslonalJty» Models and real objects 
posses this attribute, In training teachers of ex* 
ceptional children in the use of a tool or equipment 
(e.g., braille transcriber, teaching machine, oi 
prosthetic device), the actual object or its model 
should form an important part of the instructional 
package to permit meaningful practice. 



Motion. Film and video tape possess the attribute 
of showing motion, in some specialized teacher* 
training topics (e.g., flnger plays for preschool 
retarded) motion may be an integral part However, 
most protocol materials use film or video tape In 
order to present a total picture of the instructional 
event. 

Pacing. Any medium that permits the teacher 
trainee to spend as much time on each piece of In* 
formation as he wants is setf-paced. Books, models, 
aiKl real objects belong to this category. If the rate of 
Instruction Is controlled by media equipment, it is 



Medium 


Color 


Three 

dImensionalKy 




Pacing 


Random 
aceese 


Sensory 
mode 


ft 


Audk) tape 








equipment 


medium 


auditory 


digital 








self 


Print 


yes 


no 


no 


self 


high 


visual 


Iconic 
digital 


Model 


yes 


yes 


yes 


self 




visual 


Iconic 


Real object 


yes 


yes 


yes 


self 




visual 


iconic 


Filmstrip 


yes 


no 


no 


instructor 


low 


visual 


Iconic 
digital 


Slide 


yes 


no 


no 


Instructor 


medium 


visual 


iconic 
digital 


Overhead 
transparency 


yes 


rvo 


no 


indtructor 


high 


visual 


Iconic 
digital 


Motion 
picture 


yes 


no 


yes 


equipment 


low 


audio 
visual 


iconic 
digital 


Videotape 


feasible 


no 


yes 


equipment 


low 


audio 
visual 


Iconic 
digital 



Tabid 8.1 

M«dla and their attributes. 
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equipment-paced. Film, video (ape, and audio tape 
are examples of equipment-paced media; once they 
are set in motion the rate of presentation cannot be 
controlled. Slides, (ilmstrips» and transparencies are 
instructor or group-paced ntedia and in individual 
situations, they can be self^pxed. Sometimes the 
skill being taught to the teacher trainee may require 
external pacing, as In the case of rapidly discrim- 
inating a type of student response and providing 
immediate feedback. In these situations, an equip* 
ment-paced medium such as video tape is highly 
recommended. In most other cases, self^pacing Is the 
ideal to strive for, especially since teacher trainees 
prefer self^paced materials. 

Random access^ Random access Is the degree of 
referability of the medium, that Is, the ease with 
which the teacher trainee can go directly to any 
specific part of the instructional material. For ex- 
ample, the teacher trainee can skip sections or go 
back and forth In a textbook. To do the same with 
audio tape requires more time and effort, and it 
becomes very cumbersome to locate a specific section 
in the middle of a film. Although random access can 
be added to any medium through electronic means, 
the process is often prohibitively expensive. 

Teacher trainees frequently prefer media with 
random access which enable them to restructure a 
sequence, skip known parts, and selectively review 
materials. If the developer is interested In providing 
different tracks of instruction according to the 
teacher trainee's performance and preference, rapid 
random access is an important consideration 

Sign type* Conveying information through ar- 
bitrary signs (e.g., words, numerals, and mathematical 
symbols) Is a verbal presentation. Using signs that 
resemble what they stand for (e.g., pictures) is a 
nonverbal presentation. Examples of verbal present- 
ation include a description of a hearing aid on audio 



tape, a graph plotting frequencies of temper tantrums 
of an emotionally disturbed child, and a set of written 
directk>ns on how to fiimlsh a resource it>om. The 
same information can be presenced nonvetbally by 
showing the actual headng aid or a film depicting 
the behavior of the emotionally disturbed child or a 
floor plan for the resource room. Although an In- 
structional material is rarely exclusively verbal or 
nonverbal, certain guidelines Indicate how a choice 
should be n^ade. Nonverbal segments are usually 
better than verbal ones for attracting and holding 
the attention of the teacher trainee. Also, they 
encourage open-ended responses. Thus, to elicit a 
wide variety of solutions to the handling of a problem 
child, a film or video tap;^ presentation is superior to 
a printed description, However, nonverbal presenta- 
tions contain many distractors and Irrelevant ''nolse.^' 
Hence, during the initial prestntation of a Concept, 
the addition of a verbal explanation will focus the 
teacher trainee's attention on the critical attributes. 

Sensoiy mode. Most of the media used in teacher 
training transmit information through the ears or 
eyes. Educators of the blind find the tactile mode 
very useful and they make extensive use of real objects, 
models, and braille materials as media. However, in 
this section our discussion will be limited to the 
auditory mode (audio tape), the visual mode (slide, 
filmstrip, transparency, model, and real object), and 
the combined audio-visual mode (video tape, film, 
and slide-tape set). 

Table 8.2 lists various factors determining the 
preference of one sensory mode oyer the other. 
Sometimes our media needs may suggest the simul- 
taneous use of both modes» as in the case of the 
teacher trainee looking at the test profile of a learning 
disabled child while listening to an interpretation 
on audio tape. In such audio visual presentations, 
three combinations are possible. 
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t. SumiH^iUv* oomblnatlont 
(#.0 » <^^ftef M of in aAr). 



a. fladundint eomblnallon: 
VafbalmtMagaon th« 
•cra#n(«.o.,iMtollrv* 
$(rii<tloni for dtvaiop^ng 
r#«d1r>0 rHdinaM io pra^ 
ichool ratardfd). 

3. lnt#rf#rlnQ 0inblnalior): 
lrrai«vint pfctgra (pieiMra 
of addaf^ikl tnacri^i- 

room); 



Balatad narration (a.o., 
daicrtptlon ol howdlffar^ 
antpirtiof thaaarmay 
ba affactad, raaoltlng fn 
diffarant typai of daafnaaa). 

Sama maaaaga praaantad 
auditortally (a.g.;atapa 
racording of aomabody 
raading thainatructlons). 



Unralatad narration (a.g., 
daacriptlon of hoWdfffar* 
•nt parU ol tha aar may ba 
affactad, raaoiting Indlf* 
larant typea ol daafnaaa). 



For teacher training purposes, ihc second combin- 
ation is probably irritating and the third one is quite 
likely ineffective. 

Prom Media Attribulea (o Media 

By using Table 8.1 (Media and their attributes) 
in relation to the preceding discussion of media 
attributes* we should be able to answer the b^sic 
question, ''What attributes will help students attain 
the Instryctional objectives?" Once these attributes 
are listed we can proceed to Identify the best medium 
(or combination of media) Incorporating ihm. 



Vlauaimoda 
ta prafarrad If.., 



Instructional objactiva involvaa a vlaual prooaaa or 
product (a g , how to prapvVa axpo(^^«nc&-actlvlty charts 
forthaclaaaroom). 



Auditory moda 
(sprKarrad If.. 



Inttruoiional obj<^tlva Involvaa an auditory procaaa or 
product (a.g.» how to glva apaach correction drilia). 



Tha cor>capt or akiH Involvaa ^atlal ralatlon&hlpa (e.g., 
how to arrange a raaourca room). 



A laogthy verbal atatamant (e.g.. legal definition of 
mantal ratardatlon) or a compraaaad varbal statannent 
(a.g., formula for computing the ADA) Is to be preaentad. 



Tha materia) la to be Inspected for a long time (e.g., 
records on a handlcappad child). 



The concapt or skill Involves auditory attributes (e.g.. 
hew to provide apokan reinfcrtament) or temporal 
attrlbutea (a.g., rhythmic dancaa for physically handle 
capped children). 



A ahort varbti atatament (a-jf.* "Watch thial") or a atat#- 
men* with a high degree of raduhdancy (e g., what to do 
In caie of a lira (n your claasroom) Is to be presented. 



The material la to ba attended only bi.efly (e.g.. a prompt 
to help the teacher trainee to come up with the correct 
rctponae). 



Table 8.a 

Decision table for selecting the most appropriate mode. 
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An example of the important steps in media 
selection follows. Notice the specification of learner 
characteristics and Instructional objectives, the 
Identiflcatton of essential, desirabtei and irrelevant 
media attributes^ and the location of appropriate 
media combinations. 

M«dl« •#l#ction for a training moduU on tMtIo titn 
languagt. 



Tirfltt ^udtnta: 

Ir service teachers from regular classrooms In which deal 
siudents have been Integrated. 

Inalruotloni) objective: 

The teacher trainee shati generate and receive 30 common 
signs for the deaf. 

Media aHrlbutM: 

Essential: 

Ability to represent nonverbal signs (from the sign 
language) 

Visual mode (to show sign) 

Auditory mode (to describe the signs and to point out 

critical aspects while the eyes are watching the sign) 

Ability to show motion (since some of the signs Involve 

motion) 

Desirable: 

Three dimensionality (to show positions of fingers 
clearly) 

Self-pacing (since different teachers ntay require 

different amounts of time for learning) 

Random access (to permit selective review of difficult 

signs) 

Irrelevant: 
Color 



Modii Miectlon deelelones 

The requirement of molten immediately narrows our choice 
to film or video tape. Although we are forced to sacrifice 
three dimensionality^ close-up shots from varloui angles 
will compensate. Since color Is Irrelevant, btack and 
white film or video tape le suggested, Film Is superior to 
video tape (n realism, but the latter Is still acceptabte. 
Neither medium provides self*paoing or raridom access, 

Pinei Choice of Media: 

video tape or film will be used for Initial Instruction, 
Later stages of tralnlrig will Include a booklet with drill 
practice exercises and an Index for selective review. 



Although the choke of media should be based 
primarily upon instructional considerations, it would 
be naive to assume that they are the only variables. 
An ideal medium may turn out to be beyond the 
budget or pttxluctlon capabilities of the developer 
or unavailable in most teacher^trainlng programs. 
After ihe preliminary choice of a medium^ consider 
the various production and dissemination factors 
which are given in Checklist 8 J . 
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^rodMotlon and ditlrlbutton oenildtratloni 
MmadiiMlMtlon 



Production factor*: 

1r Fa<2lllties: Are production facilities available 
locally or do wo have to go elsewhere? How 
much delay should we ar^ticipate In the latter 
case? 

2. Capabllltla$: Does someone In tho development 
team have the skills necessary for media pro- 
duction? If not, can we hire someone with 
specialized technical skills? 

f:: 3. Co»t: How expensive is the media production? 
Does the budget permit it? 

A. Tochnlcal quality: Within the limits of our bud- 
gel and local facilities, cen we produce materials 
of acceptable technical quality? 

5. Developmental testing: What special problems 
will we face In trying out the materials? Will it be 
expensive and lime-consuming to revise the 
materials? If so. Is some other medium available 
for preliminary debugging (e.g., video tapes In- 
stead of film)? 



Distribution factors: 

1. Equipment: What type of equipment will the in- 
structional materials require for presentation? 
Is this equipment usually found In special edu- 
cation teacher-training programs? 

2. Setting: Are the instructional materials designed 
for use with individual learners or groups? Is the 
type of medium suited for this type of usage? 
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d. Cost: How much will It cost the teacheMraining 
program to purchase the Instructional materiat&v 
If very expensive, could the materials be rented? 

4. Packaging: What special packaging problems 
can be expected? If different types of materials 
are combined, how can they be kept In the correct 
order? How much would efficient packaging cost? 



Introduction to modia facts 

The purpose of this chapter U mt to transform 
teacher trainers into media production experts, but 
to give tticm some basic facts on different media 
which ^an h^^ usefui in preparing (eacher*tralnlng 
maleri^is. More information can be obtained from 
the selected bibliography at the end of the chapter^ 

Audio tape 

In most teacher*training instututions, tape re* 
cordersare readily available. Reet-to*reel recorders 
use V4 " wide tape, the reels come in different sizes, 
and the tape can be recorded at different speeds, 
in a cassette recorder, the tape is narrower {Vi 
wide) and enclosed in a case, which eliminates the 
need to thread the machine* and recording speeds 
are not variable. The Instrument is especially easy to 
use. Fairly good quality audio tapes can be made 
locally although the recording of protocol materials 
Inside an actual classroom presents a number of 
technical problems and requires special equipment. 
Among the advantages of tapes is that basic tech- 
niques of recording are easily learned and ttie tapes 
are easily edited and revised; furthermore, they can 
be duplicated quickly by commercial specialists. 

Audio tape is relatively inexpensive; a fmished 
tape should cost less than $5.00 for an hour of re- 

73 



corded time. For detailed Information on audio tape . 
production and methods, consult the following 
references; 

Behind the tape --the teacher, tape, 45 min. St. 
Paul, Minn.: Magnetic Products Division* ,^M 
Company. 

Creative teaching with tape. Si Paul, Minn,: 
Revere Mincom Division, 3M Company, 1969. 

Hodgson^ Dm & Bullen, H. J. How to use a tape 
recorder N.Y.; Hastings House, 1957. 

Nisbctt, A. The technique of the sound studio. N.Y.; 
Hastings House, 1962. 

Print 

Print is the most widely used and versatile medium. 
Printed materials may range all the way from a 
dittoed sheet to a high-qualUy printed book. A wide 
variety of printing and duplicating techniques are 
available and most secretaries are familiar with 
common duplicating procedures* During develop- 
mental stages, duplicated materials are inexpensive 
to revise. It is possible to reproduce copy prepared 
on an electric typewriter by the offset process. Art- 
work, photographs, and other graphic materials can 
also be handled locally. Information on print pro- 
duction techniques and methods is contamed in 
the following texts, and many of the general references 
on media production listed in the bibliography at 
the end of this chapter devote sections to print 
production. 

Brunner> F. A handbook of graphic reproduction 
processes. N.Y.: Hastings House, 1964. 

Croy» P. Graphic design and reproduction techrtiques. 
N.Y,: Hastings House, 1968. 



Slide 

A slide is a color film transparency which is 
mounted in cardboard or glass. Usually^ a set of 
instructional slides Is accompanied by an audio tape 
and/or a student manual Slides can be produced 
with an ordinary 35mm or instamatic camera which, 
with suitable acce^rles, can also be used for copy 
work. Any good photographer can become a 
producer of usable slides. However, processing must 
be done in commercial JfibPJfttoiift$ii«x«rC\v^^^ 
time is usually required. During tryouti, it is fairly 
easy to add, remove, and rearrange iftide$ to edit a 
sequence. Sets of slides can be reproduced in 
quantity by commercial sources. Each slide costs 
around $.50. Slide projectors are fairly common 
equipment tn teacher-training institutions. 

A number of excellent publications on photo- 
graphy and slide production are available from the 
Kodak Company. Write to Department 454, Kodak 
Company, Rochester, New York 14650, for their 
Index to Kodak Technical Information, The following 
titles may be highly useful: 

New adventures in Indoor color slides. Publication 
AE-7. 1967. 

New adventures tn outdoor color slides. Publication 
AE-9. 1967. 

How to make good pictures. Publication AW- 1 . 
1967. 

Producing slides and fllmstrips (4th cd.). Publication 
S-S. 1968. 

Also of use is: 

Colthorp, J. Production of 2" x2" slides for school 
use. Austin, Texas: University of Texas, Visual 
Instructbn Bureau, 1958, 




Overhead tniAspirency 

The transparency is a clear acetate sheet about 
8 H " X I In size which is relatively easy to produce. 
V^ouals may be drawn directly on the acetate sheet or 
transferred from a paper master. For Iryouts, the 
material can be drawn on paper first and the neces- 
sary changes made on them before producing the 
final version. Overhead projectors are standard 
equipment in most training programs. The references 
betow list additional information on this medium. 

BuHfs7E. f & LeMay, J. IB. They see what you 
mean. N.V.: OAR Corpofatlonv}959. 

Kelley, 0. B.* & Sleeman^ P. J. guide to overhead 
projection and the practical preparation of trans- 
parencies. Leeds, Mass.: Chart*Pak Rotex, 1967. 

Projecting Ideas on the overhead projector. /- 
General. 16mm rilm» sound, colon 17 minutes. 
Iowa City: University of Iowa. 

Projecting Ideas on the overhead projector, IhDeaio 
transparency production* 1 6mm film, sound, color, 
11 min, Iowa City: University of Iowa. 

Projecting Ideas on the overhead projector. llhDlrect 
transparency production. 16mm film, sound, color, 
5 min. Iowa City: University of Iowa. 

Film 

Sixteen millimeter (16mm) film is best suited for 
instructional materials. Film may vary in length from 
one to SO minutes; longer films must be stored on 
more than one reel. Film production is a highly 
technical skill and requires complex equipment. 
High quality production, especially of classroom 
protocols, requires the specialized skills of profes- 



sionals. Revisir*^ ;> film after final production Is 
very expensive. Initial tryouts preferably should be 
cairitd out with outlines of the material or video 
tape versions. Film projectors are fairly common 
institutional equipment, but they have to be schedufed 
in advance as a rule. Films are relatively expensive 
to purchase (average cost of a lO-minute color film 
is about $120) but they are frequently offered on a 
rental basis. For additional information on film pro- 
duction, see the following selected references: 

Brodbeck, E. E. Handbook of basic motion picture 
techniques. K\ A McGrmM^^^^ 

Buchanan, A. Film making from script to screen. 
N.Y.: Macmillan, 1951. 

Film Problems. 16mm film, sound, black and white, 
8 minutes. Bloomington, Ind.: Indiaha University. 

Spottiswood, R. Film and Its techniques. Berkeley: 
University of California Press, 1957. 

VMeotape 

Modern video tape recorders permit local pro* 
duction. The instructional materials can be shot in 
a television studio or in the classroom using a port- 
able recording unit. A number of persons are required 
to operate different cameras and microphones. 
Unlike film, video recordings can be erased and 
tape reused. Minor changes after tryouts can be 
handled through editing. For major changes, an entire 
sequence can be recorded again. Because of their 
use in other aspects of teacher training, video tape 
recorders (VTR's) are becoming available In special 
education teacher training programs. A reel of tape 
providing an hour of recording time costs around 
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8tlMttd bibllosraphy on m%6\$ production 



$30. HalMnch tape is most commonly used. Because 
it is a relatively new product, standardization of 
VTR's is not universal and caution should be 
exercised when Investing In equipment to be certain 
the VTR purchased is compatible with other popular 
brands on the market See the selected references 
listed below for additional information on video 
tape and television production. 

Demonstration kits for utilizing Instructional tele- 
vision. III: Prtparlng the TV lesson. 16mm film, 
sound, black and white, 28 min. Dekalb, III.: 
National Association of Educational Broadcasters. 

Mitlerson, F. The technique of television production. 
N.Y.: Morgan* Morgan, 1961. 

Zetll, H. Television production handbook (2nd ed.) 
Belmont, Calif.: Wadsworth, 1968. 



Brown, J. E., Lewis, R. B., & Haroleroad. F^. P. ^*V^ 
instruction: Materials and methods (4th od.) N.Y/. 
MoQrdw*HllU97d. 

OafOi E. Audiovisual materials In teaching (drd ed.) 
N.Y.: Holt, RInehart & Win$ton, 1969. 

DeKleffer, R. E. Audiovisual Instruction. N.Y.: The 
Center for Applied Research in Education, 1965. 

Erickaon, 8< W. H. f^undamentals of teaching with 
audiovisual technology. N.Y.s Macmillan, 1965. 

Qertach, V. 8., & Ely, D. P. Teaching and media: A 
systematic approach. Englev/ood Cliffe, N.J.: 
Prentice-Ha!U971. 

Kemp. J. E. Planning and producing audiovisual 
materials (2nd ed.) Scranton, Ph.: Chandler 
PubliahlngJ96d. 

Kinder, J. 8. Audiovisual materials and techniques. 
N.Y,; American Book J 966. 

Minor, E.. & Prye, H. R. Techniques tor producing 
visual instructional medle. N.Y: McQraw-HIII, 1970. 

Wittlch, W. A., & Sohulter, C. P. Audiovisual ma^ 
terlals: Their nature and use (3rd ed.) N,Y.: Harper 
& Row, 1962. 
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Chapter 9 
Pormat talaotlon 



Obiectlvet 

1. Differentiate between protocol and training ma- 
terials in teacher preparation. 

2. Differentiate between Instructional nr>anagement 
formats and cOntent*deslgn formats in training 
materials. 

3. Explain briefly and give examples of resource* 
management, mastery-learning, print, multimedia, 
smatl*group, and computer-based formats. 




The term ''instructional format'* is a difficult one to 
define; it refers to a combination of media, leaching 
strategies, and utilisation techniques. Sometimes 
format Is used synonymously with medium, as in 
television format; often It goes beyond media, as In 
self-lnstrucihnal formats ^hkh use different media; 
sometimes it refers to sensory mode (e.g«, visual 
format and audio-visual format) and sometimes to 
sign type (e.g., nonverbal format); and frequently 
the term refers to external characteristics, as in 
textbook format or lecture format. 

All Instructional materials for the preparation of 
teachers can be divided primarily Into pmtocol and 
training m^^terlats. Training materials can be further 
subdivided Into man&^^ement and content-design 
formats. The classification of Instructional formats is 
shown In Table 



Protocofi 



Protocol materials are records of real or realistically 
staged instructional behaviors. They are used to 
exemplify various educationally relevant concepts. 

Basically, protocols may be designed in three 
different formats, depending upon the control we 
exert over the behaviors recorded. At one extreme 
is a scripted drama that permits total control; at the 
other extreme we may record uncontrolled behaviors 
In an actual classroom and edit out all but relevant 
excerpts. Somewhere in between are minimum 
structure protocols that involve recording a loosely 
structured roleplay. 
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Clatilficitlon of 
iMtruetlonil formiU 



PrQtocol miltrlili (Chftpttr 10) 


Training milerlali 


ScHpted pfoiocoli 


M«ni0emeni(ormeti 


Content design formate 


Edited axcerpti 

Minimum structure roleplftyi 


Resource-management formate 
vonaptef 11) 


$etf*}r<<%trijc,k>nai print formats 

{I hf pier 13; 




OblecUve outline 


Textlwok/handout 




Resource list 


information mapping 




Field training 


Programmed instruction 




Mastery-learning formate 
(ChapteM2) 


Setf-instructk>na1 multimedia format 
(Chapter 14) 




Adjunct pfog ramming 


Audiotutorlal module 




Repeated testing 


Multimedia module 




Personatlzed system of instruction 


Mintcoursea 
Small group fo«<nats (Chapter 15) 
Roteplay 

Instructional games 
Simulation 

Computer-based formats (Chapter le) 

Computer-assisted Instruction 
"CARE" 

Computer administered repeated 
testing 

Computer-assisted teacher 
sMtl training '•CATT^^' 



Table 9.1 
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Training maUriats deal with the acquisition of 
performance skills In teaching situations. They may 
be subdivided into management and content-design 
formats. Following the specification of objectives In 
the Instrucllonal-development process, we may de- 
cide to use already exUtlng Instructional resources. 
Whit Is needed In this case is a management struc- 
ture to help the trainee choose the most suitable 
resources and use them selectively. The following 
two m^r formats use the management approach: 

Res<Hir«« manif «N)cot rorwaii. A suitable man* 
agement format cart be biised on behavioral objectives 
arranged In a hierarchical sequence, Perhapi all the 
trainee needs Is this outline of objectives. Howc'vfer, 
we could offer him more by locating different re- 
source materials, persons, and Institutions and keying 
them lo our different objectives. We could also 
suggest various acitvitles (reading, visiting, inter- 
viewing, and discussing) which will enable the trainee 
to attain the objectives effectively. 

Masteiy learning romtM** Continuing a little 
further In the Instructional-development process, o«f 
objectives can be converted Into criterion-referenced 
tests and Uied as the basis for Instructional manage- 
ment. Bloom and his associates ( 197 1 ) have suggested 
a mastery-learning format in which criterion-tests 
are repeatedly taken by the trainee until he achieves 
a prespeclfled $tandard. In this case, test taking 
becomes an instructional strategy for identifying 
areas of weakness and remediating them. Criterion- 
test based formats require the design of equivalent 
versions of the test and devising strategies for scoring 
large numbers of tests and providing immediate 
feedbacic to the trainee. 
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CoAlent-ileilgii fomtatt 

Another type of training materials involves the 
design and development oHew materials. These may 
be further divided Into the following four formats: 

SelMaidv^iionat print foimafi. Printed Individual' 
use materials are fairly inexpensive to produce and 
permit nexible usage. Programed instruction Is an 
example of print format made effective through the 
systematic application of the InstructlonaJ-devclop' 
ment process. 

MaitlineiUa lelMniliveiioiial foi^aii. Thes« are 
Instrtictlonal modules for Individual .tralnws to be 
used In learning earfels. Medlit«l modules require 
more time ind effort to produce than do printed 
materials but thtiy are usually more effectlv0 an<i 
motivating. 

PomaU fot saiaU-|roti|i leamim. Instructional 
materials In thtsgroup are desigried to ir^ufre 
interactbn among differerit trainees. The formau 
include rolepl^y, instructional games, and slmu* 
latlpns, all of )vhlch encourage th«> trainees to learn 
from each other, Small-group formats are especially 
useful for attaining affectiv? wid social outcomes. 

Compuler-bas<<l roraiatf« Overlapping the self- 
instructional and group formats are several materials 
which are Identified by their dependency upon the 
computer. The Imaginative use of the computer 
enables us to accomplish high cost-effectiveness 
which is otherwise not feasible, 

Selecting a format 

The next seven chapters of the sourcebook deal 
with groups of instructional fomtats. Each chapter 
provides examples of instructionM materials In each 
format, taken wherever feasible, from existing 
materials used for training teachers of exceptional 



children. Guidelines for the design of materials in 
each format are \l$o provided. Depending upon the 
complexity of the format, the adequacy of these 
guidelines varies. For example we have not detailed 
the %1esign of computer-based formats. In all cases, 
however, we have provided references to boolcs, 
articles, and mediated resources that basically offer 
"how-to^*' instructions rather than theoretical 
discussions. 

Although the superiority of a particular system is 
usually extolled by its practitioners, we must caution 
readers against b(N:oming single*format developers. 
We recommend exploration of all 21 format vari- 
ations before settling on a specialty. There are no 
simple guidelines for the selection of format Other 
than certain obvious aspects (e.g., for affective out« 
comes, small-group formats are preferred), format 
selection depends upon a number of factors including 
available resources, plans for dissemination, project 
deadlines, and the subjective preferenceri of the 
developer. 



Chapter 10 
Protocol matorials 



Oblectlvei 

1. Describe the nature of protocol materials and 
explain their role In the preparation of teachers 
of exceptional children. 

2. Select the number of concepts, length, typo of 
media, nature of adjunct materials, and degree of 
staging for protocol materials on a suitable edu- 
cational topic. 

3. Specify examples and nonexamptes to be used 
In the protocol through an analysis of se1ect9d 
concepts. 

4. Using any one of the three procedures recom- 
mended in thechapter,prOduceprotocol materials. 



Protocol materials are records of real or realistically 
staged behaviors. Originally, protocols were nar- 
rowly deflned as uneditedl records of unrehearsed 
behavion Because producing such records is often 
too wasteful and unpredictable to be relied upon, 
current protocols are usually edited e7(cerpts or 
scripted productions on audio or video tape, or film. 
The purpose of a protocol is to provide a raW-data 
base for e;(emplifying theoretical conceptSr However, 
protocols are not portrayals of model behaviors. 
They are not accompanied by any interpretative 
narration. What each teacher trainee sees In the 
material depends upon the conceptual framework 
he h ings to it, 

Protocols provide concrete referrents to various 
educationally relevant concepts. In this way, they 
are superior to the traditional text*and*lecture 
approach to teaching concepts. The use of protocols 
also offers certain advantages over pbservations of 
actual classrooms because of fewer logistic and 
administrative problems and tighter contrpl over the 
types of behaviors recorded^ On the negative side, 
the attempt to portray the reajlties of the classroom 
may result in dull and uninspiring prptON^^ts. The 
lack of strong story lines, outstanding performances, 
and closure may make the vieweirs uncomfortable 
the first time they view a protocoi To an audience 
accustomed to slick product|<?n, the appacent point- 
tessness and blandness of a protocol <;an be very 
disquieting. Sometimes protocols reflect the un- 
conscious bias^ of the prcxiuc^^^^ his honest 
efforts to be cntireiy neutral. 

Although the guidelines for the design of training 
materials overlap to some extent with the design of 
protocol materials, this chapter deals with issues 
which are unique to the preparation of protocols. 

Nature and number of concepts. In special edu« 
cation, protocol materials usually deal with those 
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concepts that are both behavioral and interactional. 
Asking questions, counseling parents, providing 
response feedback to retarded children, and behavior 
management are a few examples. Within a selected 
domain, a protocol should portray no more than four 
or Ave major.concepts. These concepts can be anti- 
thetical pairs of behaviors (e.g., accepting and re* 
jecting) or sublevels of the same general concept 
(e.g., low-Ievel cognitive tasks: Imitating, repeating, 
observing* and describing). Parenthetically, it should 
be noted that in the first example some problems 
of authenticity may arise if the same teacher is used 
to portray both behaviors. 

Length of pit>tO€Ol8. Our experience in field test^ 
ing a number of protocols with trainees suggests that 
the ideal length is about 5*7 minutes. Because pro- 
tocols do not have a story theme, a trainee's attention 
is not usually sustained nor Is he always able to recall 
some of the early segments^ if the protocols are 
longer. Larger domains of concepts can be effectively 
portrayed in a series of short protocols in which 
primacy and recency effects are less likely to have 
an impact on trainee responses to the materials. 

Media selectton* The protocol can be a printed 
script, an audio tape, or a film. To record purely 
auditory-verbal interactions (spoken words), audio 
materials may suffice. However, since the ultimate 
objective of protocol materials is to provide the 
trainee with conceptual toots to interpret what is 
happening in a classroom with all its rich distrac* 
tiohs, an audio visual medium (video tape or film) 
is strongly suggested. Authenticity and realism are 
very important in protocol materials. Unless the 
video tape is of studio quality, the most effective 
medium is color film. 

A4|MiKt materials* Protocols may be used In a 
number of different ways. At one extreme, they] are 
left open-ended to be used at the discretk)n of tne 
trainer. At the other extreme, they are incorpoiated 
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into a closely-knit system with volumes of paper* 
and'pencll training materials. 

Staging vs real life. Originally, protocols were 
meant to be unrehearsed and unstaged events In the 
classroom. Currently^ however, according to Oliess- 
man (1972, pp. 5-6), "It is clear * * . that the original 
conception of protocol material as an unedited 
documentation of behavior was an Imperfect one. 
'Critical* behaviors do not always occur with suf- 
ficient frequency or clarity in on-going situations to 
be *capturcd* by means of documentary techniques. 
In one way or another, the developers of the pilot 
materials have found it necessary to assure the oc- 
currence and to increase the salience of the behavior 
exemplifying the concepts they have selected.*^ 
Three different formats **to assure the oc^. Mrrence 
and to increase the salience of the behavior'^ are 
described later In this chapter. An understanding of 
these formats requires familiarity with concept 
analysis (Chapter S). 



Concept analyaii at tha baaa for 
praparing prolocola 



A number of instructional strategies (e.g., Markle 
& Tiemann, 1971) are available for prescribing 
examples and nonexamples for instructional ma- 
terials. They are based on the analysis of a concept 
into critical and irrelevant attributes. Successful 
mastery of a poncept requires that the trainees 
generalize to the full range of examples of the inter- 
actional behaviors and dtscrlmlnate eyen ver> fine 
nonexamples. To achieve these outcomes, a wide 
variety of examples and close-in nonexamples 
should be portrayed in tlie protocols. | 

The list of irrelevant attributes of a concept helps 



to det<^fmlne the range of examples to be used. Ir« 
relevant attributes, by deftnitiont are those by which 
examples may vary without losing their membership 
In the concept category. Examples in a protocol 
must reflect the total possible range of irrelevant 
attributei For example, one of the irrelevant attri* 
butes of the concept physical aggression, which was 
Identified in the discussion of concept analysis 
(Chapter 5), is the target of aggression. It does not 
matter whether the child attacks another child, the 
teacher, or someone e|se. If all examples in the proto- 
col depict only aggressive acts against other children, 
the teacher trainee may not be able to generalise this 
concept to the instance in which a child attacks the 
teacher. Table 10 J illustrates how different examples 
are generated from the set of irrelevant attributes 
of the concept pupil physical aggression^ 



IrrelsviM Examplts ef Virlitlens of 
ittrlbutsi Ihs Irrtttvant iltribirtsi 



Target of 
aggression 



Form of 
aggression 



1. Mary fighting with John. 

2. Mary fighting with the school nc/rse. 

3. John fighting with his i$9eh$r, 

4. Mark fighting with four other chltdr&n, 

1. Mary A/e/ir/ng someone else. 

2. John throwing a book at the teacher. 

3. Mary biting the school nurse's hand. 

4. Mark punching and hitting others. 



Vertal 

accompftniment 


1. 


John screaming (nsulti while pulling 
Mary's hair. 




2. 


Bob sllentty tripping Mfifk. 


Retaliation 


1. 


An unprovokecl aggression. 




2. 


"ShehUmeflrstr^ 


Location 


1. 


A fight in the ciMroom. 




2. 


A fight In ih$ pt$ygroun<f. 




3. 


Aggression in the c$t0t$rl0. 



Table 10.1 

Devetopment of examples from the list of Irrelevant attri- 
butes ol the concept phy»lcsl »ggresslor>. 
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The li&t of critical attributes helps us to specify nOn« 
examples for portrayal In the protocol to strengthen 
discrimination. Close-in nonexamples are behaviors 
that lack only one of the total set of critical attri- 
butes. For example, one of the critical attributes of 
the concept pupil physical aggression (in the special 
sense of the term) is that it is an act of a pupil. By 
eliminating this critical attribute and retaining all 
others we come up with this nonexample: 

Tom 9we«r« In the erast. The teacher, Mr. Cooper, grabs 
him by the shoulder and swats him, saying, 'I'll teach 
you never to swear In this class againt" 

r, Cooper's behavior has all the other attributes of 
physical aggression-- it is off*task, interactional, 
unfriendly, and physical— but it is not a pupil's act 
andi therefore, should not be classified as an ex- 
ample of physical aggression* Through nonexamples 
of this nature we strengthen the trainee's under- 
standing of the boundaries of the concept. Table 
10.2 illustrates the systematic use of critical attributes 
to generate a set of nonexamples. 

The next step in working out a prescription for 
the protocol is the sequencing of examples and 
nonexamples for efficient instruction. The following 
guidelines a;e based upon a number of concept- 
acquisition studies (Clark* 1971). 

Begin with clear-cut positive examples of the 
concept. For the protocol on pupil physical aggression 
we may begin with an incident like this: \ 

The children are inslructod lo work on their Individual 
assignments. Mark whispers to Mary, "You have an ngly 
face)" Mary jumps up, visibly Infuriated, and starts 
punching and kicking Mark. The teacher steps In and 
separates them. 

Ail the critical attributes of phjsi^cal aggression are 
salient in this example; it clearly Involves a pupil 
physically interacting with another with anger and 
hostility. In this incident the critical attributes are 



Crittoil Nonexamples generated ommlsslen of 

attribute the erltlcil attribute 



An act by a Tom swears In the class. The teacher, Mr. 

pup//. Cooper, grabs him by his shoulders and 

swats him, eaylng, "I'll teach you never 
to swear in this class again." 



Pupit Is nof The teacher Is refereeing a wrestling 

working on the match. Jim has his knee sticking In 

task assigned by John's stomach and tries to pin his 

the teacher. shoulders to the mat. 



Pupil interacts Susan takes a pair of scissors and starts 
with «ome of/ier cutting up her dress. She Is definitely 
person. angry about something. 



The interaction Mr. Cooper asks John, "Who invented 
is phys}cat. the automobile?" John gets very angry 
and shouts back, "WhocaresI You 
always pick on me. t hate your gv isl" 



The interaction Mr. Cooper asks the pupils to work by 
Is Intentionally themdslves on their tests. John tickles 
unfriendly. the giri In front of him. 



Table 10.2 

Development of a set of nonexamples by omitting one 
critical attribute at a time. 
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intrinsically salient. We may also extrinslcally In- 
crease the saliency by using suitable camera tech- 
niques. For example^ we can show a shot of the 
assignment on tho blackboard (to remind the viewer 
that the fight Is defihitely off-task), add a close-up 
of Mary*s face to depict the anger and hostility, and 
freeze the action at the moment Mary's punch lands 
on Mark's stomach. We can have an Instant replay 
to emphasize all the critical attributes. Usually, 
however, we should be able to build saliency into 
the e'^tions of the children without resorting to 
excessive phot<>graphic manipulation. 

Continue with more examples In which the 
critical attributes become gradually more subtle. 
From the wide range of examples we have developed 
from irrelevant attributes^ we can now introduce 
those which are not so clear-cut This procedure 
increase the range of behaviors to which the teacher 
trainee must generalize* 

Intrtxluce nonexamples. We may now introduce 
those close-in nonexamples prescribed from critical 
attributes to ensure the trainee's ability to discrimi- 
nate. To begin with, a nonexample may be presented 
immediately following an example which matches it 
in all respiKits except for the missing critical 
attributes. !ilere is an example of such & matched 
pair: 

Example 

A sign on the cba)Kt>oard says: "Assignment: pages 
92-9$:* Most Of the children are at thoir desks working 
on their asslgnmeni Jim and John are f ightlrig on the 
floor. Jim haa his kr)ee In John's stomach and la irylng to 
pin him downi gruntlrvg. "You rat Don't ever call me a 
moron agair>, or I'll knock your teeth In next time." 



Nonexample 

A sign at the gym door says, "Practice match today/' 
The children are In their gym outfits and the teacher Is 
refereeing a wrestling match. Jim has his knee dn John's 
stomach, and is trying to pin his shoulders to the mat« 
grunting. "Come on , * » let's eee you get out of this one/' 

Introduce a random set of examples and non^ 
examples. At this stage, trainees are ready to face 
more realistic and unplanned incidents in the 
classroom. 



AlternftiivQ formats for preparing protocols 



Foimat It Scripted protocota 

All these specifications and the sequence for 
different behaviors to be portrayed could be In- 
corporated into a script for a cla$sroom drama. This 
play could then be produced like any other play and 
shot on film. A number of high-quality protocols 
have been produced In this manner However^ the 
format has two major disadvantages: The time and 
resources needed for production are fairly high and 
the final product frequer}tly lacks authenticjlty unless 
the acting is of professional quality. 

Format lis Edited excerpts 

This format begins with a large pool of unstaged 
protocols from an actual classroom. A hidden camera, 
or a camera which turns itself on and off on a 
random basis over a long period of time, may be 
used to prevent the teachers and pupils from be* 
coming inhibited or showing erf. Once the pool of 



behaviors is obtained, It Is analyzed carefully for 
relevant segments. These segments are further 
classified into examples and nonexamples and 
arranged in order of their sallency. The final version 
of the protocol is prepared by splicing the segments 
together according to the sequence indicated earlier. 

A number of effective protocols have been pro- 
duced in this format and they provide a wide variety 
of realistic behaviors. With rapid switching from one 
short segment to another, the teacher trainee's 
attention is maintained for a longer period of time. 
However, these protocols lack continuity and pre- 
sent a disjointed appearance. Further, because of 
the expense involved in shooting the original pool, 
we arc limited to the use of video tape. 

Foimat III2 Minimum stnjcture simulations 

Somewhere in between these two formats is the 
In situ roteplay in which the general nature and 
sequence of the conceptual refe rrents are guaranteed* 
although specific details are unpredictable. Here arc 
some guidelines for producing minimum structure 
simulation protocols. 

□ Based upon the concept-analysis specifications, 
select a suitable situatitn in which behavioral ex- 
amples are to be portrayed. Specify the type of 
classroom, number of children* and content of the 
lesson. 

□ Select a teacher and a set of pupils for a loosely- 
structured roleplay. Explain the details of the lesson 
to the teacher and sriecify the general class of 
behaviors he is to exhwit. Within these coastrainls, 
he is free to **do his olvn thing." Most of the children 
are merely told to behave as if they were irj their own 
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classrooms. Some children receive cue cards with 

directions like these: 
When the director holds up a card with the num* 
ber 9, start pulling your neighbor's hair. Do this 
gradually. If and when your teacher notices it and 
talks to you, do exactly what you would do if you 
were in your classroom. 

□ Conduct some rehearsals to adapt the players to 
microphones and cameras and to make sure everyone 
knows his role. During these rehearsals make note 

of any special talent pupils may have for portraying 
roles in later segments. 

□ Shoot the protocol in short segments. Between 
these segments give feedback and distribute new cue 
cards. If unsuccessful in getting across some im- 
portant behavior, try again in the next segment, 

Suggostlons for further reading 

Babick, A. & Qli6S8man< D. Nature and systematic 
use of protocol materials In teacher education. 
Viewpoints, 1970, 46, 129-138. 

Hudoins, B. B. The portrayal of concepts: An Issue in 
the deyetopment of protocol materlafs. In Ac- 
quiring teaching competencies: Reports and 
studies, Report /. Bloomlngton, Incl.: National 
Center for the Development of Training Malerlats 
in Teacher Education, 197t 



Chapter 11 

R0source*management formats 



ObJecUve$ 

1. List the Important features and provide examples 
of the resource management format. 

2. Pffepare an objectives outline package for a 
suitable instructional topic. This package should 
inctude specific objectives arranged In sequence, 
a criterion-referenced test based on the ob- 
jectlveSr and a directive explaining the use of 
the package. 

3. Prepare a resource list on a suitable topic keyed 
to instructional objectives. This package should 
include specific objectives arranged in sequence, 
textual and mediated resource materials related 
to each objective, a criterion*referenced test 
based on the objectives, and a directive explain- 
ing the use of the resource list. 

4. Prepare a field-training package on a suitable 
instructional topic. This package should include 
Ifsts of human and Institutional resources and 
criterion assignments in addition to the materials 
found In the preceding format. 



Resource-management formats systematically struc- 
ture the use of existing teacher-training materials. 
A% in the development of any other Instructional 
materials, the trainer begins by defining instructional 
requirements* 

We have identified three resource-management 
formats; objectives outline, resource list, ^nd field 
training. In the first, only objectives and criterion 
tests are given to the trainees. What happens in be- 
tween is left to the ingenuity of the trainees* In the 
second, the resource list format^ the trainee is pro- 
vided with an additional annotated list of resource 
materials. More clues to and contact with human 
and institutional resources are provided for the 
trainee in the competency-based field-training format. 

These three resource-management formats are 
compared in Table I M. Later, each format is 
described in detail and one or more examples from 
the training of teachers of exceptional children are 
provided. Step-by-step procedures and useful refer- 
ences for the design of instructional structures in 
each format are also given. 



1. ObjMttvM outlino 



Based on the assumption expressed by Mager 
(1962), "If you give each learner a copy of your 
objectives, you may not have to do much else," this 
format is best suited for those units in which altema 
tive resource materials are available, and for in- 
service training situations in which there is no great 
time pressure. The developer may begin with this 
format and gradually move into more sophistiCi'^ted 
versions, such as those described in a later sec: ion 
of this chapter. 
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Format 




iiisu uviivimi ivvvuivVv 


1. 


Oblectives outline 


Behavioral objer arranged 
In a hierarchy. 

Criterion tests and assignments. 


Left to the teacher trainee's Ingenuity. 


2, 


Resource list 


Behavioral objectives. 

Resource lists keyed to the objectives. 

Criterion tests and assignments. 


Textbooks, articles and research reports. 
Mediated rc^urce materials (filmSi etc.). 
Supplemeriary handouts. 


3. 


Field training 


Behavioral objectives. 

List ol resource materials and 
resource persons, 

Field'placoment tasks. 
Criterion tests and assignments. 
Performance tests. 


Existing textual and mediated resources. 
Professionals and experts in the field. 



Table 11.1. 

Resource-management formats for training 
teachers of exceptional children. 



An example of the objectives outline format 

On the first day of a course, teacher trainees are 
given the directive shown in Figure 11.1. Anytime 
before the end of the course^ they take the criterion 
test, which is just a reproduction of the objectives^ 
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AlUmailvt iKlmlntttrativ* ttructurt s to htip 
handicapped chlldran 

Handicapped chlldran may be eerved through a variety 
of admlnlstrailve etructurei Each of these has Its own 
strenothi and weaknesses. As a prospective teacher of 
the handicapped, it is essential that you are familiar with 
these administrative structures. 

Given below are a set of behavioral objectives. You are 
required to ettain all of them before the end of (his 
semester, fnformatlori needed to master these objectives 
is avaUable from a number ol different textbool(S and 
pamphlets In the Special Education Reading Room. 

This Is iust one of the many requirements of this course. 
Schedule your time suitably. Any time you are confident 
that you have attained all the objectives, check with your 
instructor. He will give you a criterion test which is solely 
based on these obiectives. 

Obieclives 

1 . Briefly describe the essential characteristics of each 
of these educationa) structures from the point of view of 
handicapped children: 

Educational mainstream 
Integrated speclsl class 
Adiusted regular class 
Informal classrooms 

Your description should Include the rationale for the 
structure, its strengths and weaknesses, and physical 
characteristics. You should be able to provide the de- 
scriptions without any references. 

2. Describe a resource room and explain its relationship 
to a regular classroom. 

3. Compare and contrast these four types of teachers: 

Itinerant teacher 
Resource teacher 
Consulting teacher 
Remedial teacher 

Your response should take into account the roles, areas 
of expertise, and training of each type of teacher. 



Figure 11.1 

A sample Instructional handout Illustrating the 
oblecth/es outline fornr)at. 



Guidelines for the design of objectives outlines 

□ Conduct a task analysis and/or concept analysis 
as described in Chapters 4 and 5. 

□ Derive objectives and state them in specific be- 
havioral terms. Include appropriate range, con* 
dition, standards, and time limit for the per- 
formance of each objective. A statement of rationale 
indicating the relevance of each objective to the 
teacher of exceptional children may also be included. 

□ Rewrite the objectives in language meaningful 
to teacher trainees. 

□ Arrange the objectives in the logical sequence 
suggested by the (ask analysis. 

□ Have other teacher trainees rale each objective 
on necessity, relevance, and imporlance. Revise 
suitably. 

□ Have teacher trainees arrange the objectives in 

a hierarchical order. Revise the task analysis suitably. 

□ Try out the objectives on a few teacher trainees 
to determine clarity. Rewrite the objectives on the 
basis of their reactions and suggestions. 

□ Construct a criterion-referenced lest based on 
the objectives. 

□ Prepare a handout to teacher trainees explaining 
what is expected of them and suggesting a sche<iule. 



II. Resource llftU 



This format is an extension of the objectives out* 
line format. In addition to the set of objectives^ the 
teacher trainee is provided with a coded list of re- 
source materials to help him attain these objectives. 
This format is suitable for longer instructional seg- 
ments and for entire courses as well. 

Examples of the resource list format 

Two examples of the type of information sup- 
plied to the trainee follow. Each example is just 
one section of a longer unit with other sections 
arranged in a sequential order. 



Piinithmsnt and thrsit In tht eliMroom 

OblKtim 

1. Given 20 episodes of teacher control from a clasifor 
emotionally dUturbed. you will claiDty them according 
to whether punishment or threat wa$ uaed. 

2. Qlve acceptable dellnitions of punlahment and threat 

aa teacher COntrot techniques without using any referencee. 

3. Discriminate between punlahment and threat and 
give examples of each. 

4. Explain (he relation between punishment and self- 
esteem. 

5. list specific categories of deviant behaviors which 
are more amenable lo punishment and threat than other 
control techniques. 

6« List precautions to be observed by the teacher In using 
punishment as a control technique. 



Rteding Hal 

Ausubel, 0. A new look at cfassroom disctplne. pht De/(a 
Kappanjd61.^3, 25-30. 

Clarizto, H. F* Toward pos/r/vec/ass room diic/p//nt. N.Y.: 
Wifey, 1970. 

Homme, L. E What behavlorat engineering Is. tn N. 0. 
Haring & A. H. Hayden (eds.}, r/ie /mprovemenf of 
fn$tfuGifon. Seattle: Special Child Publication, 1972, 
154-169. 

Long. N. & Newman, n. 0. Mar^aging surface behavior 
of children In school, in N. J. Long, W. C. Morse, & 
R. 0, Newman (eds.), Conftlct In l^e crasiroom. Bel- 
mont: Wadsworth. 1971. 442-452. 

Redi, F. Wh0n we dea/ with chftdr$n: Se/ecfed wr/fMgs. 
N.Y.; The Free Pfn, 196$. 251 3C5. 

Redl. F. The concept of punishment (n N. J. Long, W* C. 
MoUe. & R. 0. Newman (eds.). Con///cl {f\ ih$ clM- 
room (2nd ed.>. Belmont: Wadsworth, 1971, 434-441. 

Vernon. W. M. MoUv$ttf)g chiidr^. N.Y.: Molt, Rinehart. 
^ Winston. 1972. f9>26 and 47-5t. . ^ 



A sample resource list from a unit on behavior- 
management techniques. 
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Uil tMU whKh e«n b0 used to «m«m th« ne«<) for 
•P0C)AI 0iluc«t)on plAcdfnont •r>d rndlcite their appro* 
prf«t#r\OMfor chiidrin o( low ioc)oecOf>om(o itttui. Th^ 
list ihould cortt«(n (H(i wh ir« ut^ul In th# ld«ntl* 
fkatlon aiyj 0v«luttlon of lo«rn(A0 dieorddri And ihould 
include «t lent one tntelilg»nee. porceptui^l, retdino 
Achlevemont, diegnottic l«nou«oo. ecr^enlno and read!- 
ne$$, and aocta) compotenco teat 

Reaourea malerlala 

Buroa, 0. K. (Ed.) Th9 i$vmh wntBt m$$$ur^m§nt$ 
y$fbo0k. Highland Park, N, j.: Oryphoa 1972. 

f riarson, E. C, & 8arba, W. 6. (Cdi.) fducar/^ children 
with t99rnlf)0 dl$%blf{U4s, N.Y.: Ap.^faton Cantury, 1967 
(Sactlon 111. Dlaonoslng learning oiaordara). 

Oaarheaft, 8. A.. & Wlllanbaro. t, P. AppUc%tion ol pupil 
$s$$$$m$M inform$tfon for th9 apac/a/ education 
leacAer. Denver; Lova, 1970. 

Roblnaoh, H. $.* & Roblnaon. N. M. ThamMatfyf§t§rd0d 
chifd: A p$ycMogtc$l approach. N.Y.: KfcQraw Hiti, 
1965 (Pari 6, Psychodiagnaals). 



A sample reaource Hat from a unit on apeclal education 
placement 



Guidelines for the design of resource lists 
keyed (o Inslnieilonai objectives 

In addition to completing the steps listed for the 
development of a hierarchy of objectives (in the 
guidelines for the design of objectives outlirjes), 
perform the following tasks: 

□ Collect all available materials in the subject- 
matter area. In addition to using familiar materials, 
ask colleagues for their suggestions. Ask trainees 
who have previously taken the course for their 
opinions of different texts, Publishers' catalogs arc 
also usefi^.l In this step. 

□ Do not Jimit resource list to textbooks. Locate 
current articles in popular and professional journals. 
A CEC/ERIC search will be helpful. 

□ Do not limit resource list to printed materials. 
Some useful mediated resources are available. The 
media guides listed at the end of Chapter 2 will be 
helpful. 

□ Obtain copies of text and resource materials; 
Select the most promising set, go through each 
carefully, and find specific references to your ob- 
jectives. The more specific the references (page 
number rather than the chapter) the more useful 
the list becomes. 

□ If some objective is not covered by any available 
material, prepare your own handout. 

□ Prepare handouts for teacher trainees listing the 
objectives and specifying alternative resources. In- 
dicate a rating of each resource using some con- 
venient coding. 
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□ Update the lists by reviewing and adding addi^ 
tional Instructional resources. Collect student feed- 
back on the strengths and weaknesses of each re- 
source throughout the course. By considering these 
reactions, decide to drop any material which Is 
seldom used or extremely unpopular, or change 
the ratings of different resources. 



III. Field training 



In addition to textual and mediated resources, a 
liumber of human resources are available for train- 
ing teachers of exceptional children. Professors, 
classroom teachers, supervisors, school psycholo- 
gists, special education directors, curriculum co- 
ordinators, and the children themselves have much 
to offer to the training of teachers. The field train- 
ing format will be found especially suitable during 
the final stages of academic preparation or the in- 
itial stages of work in a real classroom. 

Providing the teacher trainees with sets of ob- 
jectives, indicating where various resource people 
are available, and setting up a procedural system 
for Interviewing them, constitute an effective train- 
ing package. An excellent example of this format, 
in conjunction with the reading list format^ is seen 
in Korba, Cawley, and Pappanikou (1972), Special 
Education Placemen: A Decision System Module. 
Behavioral Objective Number 15 and the criterion 
assignment from this material are shown in the next 
column. 

Steps in the design of such a competency-based 
field training package are similar to the steps listed 
for the earlier formats. The additional step consists 
of locating and listing appropriate human resources. 
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Aft a reftult of taaka 15.01 through 15.04 you will davelop 
a tyatem for handling complalntt within an alamantary 
achoot. Crltarlort will ba mat by having an acting principal 
^Qre0 in writing that tha $^$tm you davalop could work 
In Mm achooK 

Taak 15.01 

lr> a diacuaafon with a principal, outlina in writing tho 
lyitam ha uaai to hand I a complalnta In hia achool. 

Taak 15.02 

Rapaat laik 15.01 In a aacond achool. 
Taak 15.03 

Aak a profaaaof In aducationat adminlatration to racom* 
mand thraa raf arancaa on tha topic. Racord tha rtiBf' 
ancaa and f0ad th^matartaf. 

Taak 15.04 

Oavalop your ayalam and praaant it to a practicing prin- 
cipal along with tha attalnmant lorm corrt$pon<ilnQ to 
0b|activa15. 



A sampid competency-based f(eld«tra(n(ng segment 
(Korba, Cawley, 6\ Pappanikou, 1972). 



Attalnmanl ol behavior at ob]Ktlve number 15 



(name of atudent) 
haa outlined' a ayatam for handling compleinta that aaema 
workable within my achool (thia doea not Imply that I 
will adopt tha syatem). 



Signature 
School — 



(Principal) 



Date — 

Turn thta aheet in to your Inatructor/diacuaalon leader 
and begin working on Behavioral Objectfve Number 16. 



Assignment sheet from a field-training unit (Korba. 
Cawley, & Pappanikou, 1972). 



Chapter 12 

Mfifttery*l6arnlno formats 



Objoctlvot 

1. Qlve examples of the mastery-learning format 
and list the common elements of instructional 
n^dteriais using this format. 

2. Prepare art adjunct program to accompany a 
chapter or a text. Design a system for the trainee 
to test himself and obtain feedback. 

3. Design a module in the repeated testing format. 

4. Design a course using the personalized system 
of instruction method. This design should In- 
clude the strategy for running the system, pro- 
cedures for recruiting and training proctors, 
guidelines for taking tests, and policies for 
assigning final grades. Also, write suitable man* 
uals for trainees and proctors. 



i 



The common clement in the three types of mastery- 
learning which are discussed is formative evaluation 
through repeated testing, as expounded by Bloom 
and his associates ( 1 97 1 ). I n these formats, the 
trainee goes through the following procedures: 

1 . Learning from a variety of instructional materials. 

2. Taking a crilerlon*referenced test. 

3. Obtaining Immediate feedback on the objectives 
he has not yet attained to the required criteria. 

4. Studying again the original instructional materials 
or new ones, if available. 

5. Taking the same test (or an equivalent version). 

6. Repeating this process as often as necessary until 
specified criteria are attained. 

The three mastery-learning formats are com- 
pared with each other in the following. Each format 
is then described, and step-by-step procedures are 
provided for the design of instruction. 



1. Adjunct prosraming 



Adjunct programing provides many of the ad- 
vantages of programed instruction but requires less 
development time. This format evolved out of Pres- 
sey*s (1927) studies with a machine which taught 
and tested the learner. Adjunct programing permits 
the incorporation into the test feedback process of 
references to pertinent textual materials. It is es- 
pecialty useful when the instructional task involves 
large amounts of factual information. 
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Formal 



Initial Iniiructfon 



Faadback 



Adjunct programming 



TextbooK chapter 
or a handout 



Self-scorabie 
objective test 



Student ecores his own t6st« 
usually with the help of some 
mechanical a(d (o.g.t a punch- 
board). Scoring koy provides 
references for remedial rovlew. 



Repeated testing 



Personalized system 
of Instruction 



Alternative instructional 
resources Keyed to 
behaviora; ot)jectives 



f^epeatable versions 
o1 objective criterion- 
referenced test 



TextbooKs and alternative 
resources, peer tutoring 



Instructor scores test, provides 
feedback and proscribes 
remedial instruction. 



Criterion-referenced 
tests and oral Interviews 
administered by advanced 
teacher trainees 



Feedback from an advanced 
teacher trainee who 
administers tests 
and Interviews. 



Figure 12.1 

Mastery \earn\nQ tormats. 



An example of ac^unct programing 

In the following example, a few sample items 
from an adjunct program which accompanies the 
Administrative Guide and Handbook for Special 
Education (Texas Education Agency, 197 1 ) are 
shown. It is used for the inservice training of ad- 
ministrative personnel. The trainee uses the Guide 
for initial instruction and tests himself on objective 
items similar to those shown in the example. Along 
with the test, he is also provided with a small punch« 
board device that consists of 80 sets of perfora- 
tions, 4 to a set and numbered I through 80, cor- 
responding to the item numbers, on which he 



punches his answers. If he is right, the pencil point 
goes through the paper; if not, it stops at a backing 
sheet and the trainee must make another choice. He 
continues in this manner until he has punched the 
correct choice for all items. In the end, he is left 
with a record of his errors; if they exceed 15 he is 
advised to reread the sections of the Guide corre- 
sponding to the questions he missed. (The numbers 
below each item number on the test are the page 
and section references.) The tratnee may retake the 
test to check his mastery* The punchboard can easily 
be adjusted to give different patterns of correct re- 
sponse positions, and any number of rearranged 
versions of the test can be created. 
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1 4. Iniervice lr«^nl/>g for special ^ucat^onel 
(25/2.7) personnel In the better utilization of 

structlonal med^a Is one of the services 
provided by 

a) locr' ^ehooi boards, 

b) Spe^^il Education instructional MaterUis 
Services. 

c) Department of Audlovisuallnstruction. 

d) Regional Educational Service Centers. 

15. Theprimary purpose of the special educa- 
(1 9/2.6) tion visair^ teacher is to provide 

a) leedership for instructional improvement 
of exceplionai children through working 
with teachers and other school per- 
sonnei. 

b) essistance to the appratsai team and aid 
In detuning suitabie instfuctlonat tech^ 
niques and strategies. 

c) Informetion relative to the mental abifity 
and behaviorel characteristics of ex- 
ceptional children. 

d) liaison between the school, home» and 
community. 

16. The coordination component of diagnosis 
(14/2.5) a) appraises the psychomotor coordination 

of the child. 

b) determines the child's general level of 
educational ability. 

c) evaluates the child In his home environ- 
ment. 

d) coord'netes information from appraisal 
specialists and classroom teachers. 

17. Allocations to RehabiUtation Dlslrlcls tor 
(65/5.1) Handicapped Persons are financed 

a) entirety by ihe Federai government. 

b) entirety by Ihe state. 

c) entirety by the local school districts. 

d) none of Ihe above. 

16. A child who has a deficit in all learning 

(g/a.4) procesees between 2 and 3 standard 

deviation units below the mean of Ihe gen- 

erat popuiation Is 

a) auditorlally handicapped. 

b) minimally brain damaged. 

c) emotionally disturbed. 

d) educabie mentally retarded. 



A eample page of test Items from an adjunct program (o 
accompany Texas Education Agency's (1971) Administra- 
tive Guide and Handbook for Special Bducaflon. 



Guidelines for the design of adjunct programs 

O Analyze ihe contents of the chapter or the hand- 
out and identify importanl points to be emphasized. 

□ Write a series of multiple choice or true-false 
test items covering the essential content. 

□ Select an automatic scoring device. Use any de- 
vice that will keep the correct choices unobtrusive 
until the teacher trainee makes a response, and then 
provide immediate feedback on whether the choice 
is correct or not. In addition to the punchboard pre- 
viously described, a number of ol)ier automatic 
scoring devices are available, such as the following: 

Tabshe^fs. The answer sheet has little labs for 
each choice. The trainee removes the tab that cor- 
responds to his choice to reveal the feedback. 

Chcmieal cards. The box for the correct choice is 
printed with an invisible chemical. The trainee uses 
a special pen; the ink changes color if and only if 
he marks the correct choice. 

Concealed-image response slieets. These use reg- 
ular spirit masters. Marking the choice boxes with 
a special pen reveals the feedback message. 

Teaching machines. Various inexpensive devices 
in which lights flash, buzzers sound, or bells ring 
when the correct choice slot is touched with a stylus. 

With some of these devices (e.g., tabsheets and 
concealed-image response sheets) it is possible to 
provide page references for remedial instruction for 
all incorrect choices. 

□ Airange the alternatives to each test item ran- 
domly, but make sure that the position of the cor- 
rect choice corresponds to the answer patleni se- 
lected for the device. Failure to check this simple 
factor could be disastrous. 
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□ Prepare a set of instructions on the use of the 
adjunct program. Stress the need for carefully read- 
ing the text, and explain the procedure for taking 
the test and obtaining feedback. Instructions should 
also indicate standards for acceptable performance 
(e,g., a 90% score) and explain the selective re- 
view and retest procedure if these standards are 
not met. 

□ Try out the adjunct program on a few teacher 
trainees, collect their response sheets (anonymous- 
ly, if necessary), and conduct an item analysis. 
Identify ambiguous items in the test and rewrite 
them suitably. 

An analysis may also reveal some items which 
are missed by trainees, not because of ambiguous 
wording, but because of insufficient coverage of the 
topic in the text In this case, prepare supplemen- 
tary instructional materials. 



11. Repoated testing 

This format is a combination of adjunct pro- 
graming and the objectives-based resource list 
formats. 

An example of repeated testing 

Here is a description of a course in statistics re- 
quired of special education students, and illustrated 
in the following flow chart. Figure 12.2, The stu- 
dent begins by taking an entry test. If he lacks the 
prerequisite arithmetic and algebraic competencies, 
he h asked to work on remedial materials and then 
to lake the entry test again* Whenever he passes 
this test he is given a course manual that contains 



the specific behavioral objectives for various units, 
along with lists of suitable instructional materials 
keyed to these objectives. After working through the 
appropriate instructional materials, the teacher 
trainee takes a self-test and scores it himself. Both 
the test and the scoring key are also givtn in his 
manual. If he is not satisfied with his performance, 
he returns to his instructional materials or selects 
new ones and restudies the unit, paying special at* 
tention to those objectives he missed earlier. When- 
ever the teacher trainee feels that be has mastered 
the objectives for the unit» he reports to a testing 
center and takes the criterion test based on the same 
set of objectives. If he does not reach the criterion 
level (usually 90% or more) in this test, he is re- 
quired to restudy the ui.'.t and take another parallel 
form of the test. If he falls the test for the third time, 
he meets a faculty member for a diagnostic inter- 
view. Any time he passes the criterion test, the 
teacher trainee proceeds to the next unit using the 
same procedure. After passing all criterion tests for 
the course, he receives his grade. 

Design of materials for repeated testing 

Most of the steps have been discussed earlier. For 
details of designing parallel forms of criterion tests, 
see Chapter 7. For information on locating and 
collecting various resource materials, refer to the 
discussion of guidelines for the design of resource 
lists keyed to instructional objectives in Chapter 
10. One additional step is required: preparation of 
a course manual for the student-teachers. 




Figure 12.2 

Flowchart illustrating mastery-learning 
tt^rough repeatod testing format. 



III. Personalized system of instruction 



Th« main feature of this format is the use of ad- 
vanced teacher trainees^ that is, those who have 
successfully completed the unit, as student proctors 
for repeated testingi immediate scoring, and feed- 
back* As in the previous format, the teacher trainee 
studies ea^h unit on his own. Whenever he is ready 
for the unit test, he finds a student proctor to test 
him. 

An example of personalized instruction (P<I.) 

Ferster and Perrons (1968) text Behavior prin- 
ciples is a fine example of the PJ. format. Each 
unit begins with a study guide containing a preview, 
rationale, list of technical terms, and an outline, 
and is followed by textual materials divided i)V::o 
logical parts. Each part concludes with a sug- 
gested set of interview questions. Testing is done 
in a one-to-one interview situation. Proctors are in- 
structed to probe the trainees carefully for evidence 
of total mastery of all objectives. After being suc- 
cessfully interviewed on a unit, the teacher trainee 
proceeds to the next one and becomes qualified to 
interview and pass other trainees. 

Most current versions of Personalized System of 
Instruction (PSI) replace interviews with more 
format paper-and-pencil testing. They also utilize 
a variety of existing tests anif instructional materials. 
A sample unit from Born (1970a) follows: 



Unit 3 

Methoi^s of controlling behavior: 

II, Decreasing the strength of behavic*" 

Your reading assignment for this unit: 

a pp. 25-63 ThB Anatysis of Human Operanf D<fh$vlor 

b. pp. 29-36 Ana/ys/so/ee^av/of 

Your study questions (or this unit are as follows: 

1. What is r$$pond0nt extinction? In the description of 
the case of Peter on page 25, the end of the (ir$t 
paragraph states that the b*mny was renf>oved after 
Peter . . once more burti ,nto tears. . . ." if one Is 
trying to eliminate crying in the presence of the 
rabbit, why might this not be a good Idea? (Hint: Is 
crying a respondent or en operant?) 

2. How does opBraM extfnctlon resemble respondent 
extinction? What are some of the differences between 
extinction of approach be^)avlor and extinction of 
avoldanca behavior? 

3. What is satiation? Hew has satiation been used to 
modify effectively Instances of "misbehavior" (n psy- 
chiatric patients? 

4. What are the three major complications Involved In 
the use of punfshmBnt as a technique for controlling 
behavior? 

5. Specifically, what \% punhhmeot? How ts punishment 
like reinforcement (raining? How is it different? 

6. Cite tsMO obvious reasons why most of the research 
on the effects of response supprMfon has been done 
with animals other than humans. 

.'. What is the effect of mUd ahoek intensity on respond- 
ing developed under VI schedules? What Is the effect 
of intense shock? What usually happens to the rate 
of operarM responding followlr>g the wlthdrawat of 
punishment? 

8. What are the effects of ffC<fuency ofpunlahmani and 
mof/vaf Zona/ level on the rate of responding? 



Sample materials from a study^gutdo; Instructor rnanual 
for davefopnnent of a parsonatlzad instruction coursa, 
D. G. Born, ^970. Reprinted by permission. 



ErIos 



TABL£ Of CONTENTS 

J. INTRODUCTION 

A. Your role Ih thi% oourio 

II. PREPARATION FOR EXAMINATIONS 

IIL EVALUATING EXAMINATION PERFORMANCE . . 

A, QreeUng the Stodont 

B. Teach, Don't Lecture 

a Initial Testing 

D. Conditional Pass , , 

E. Mirror Mistakes 

F. How to Fail Students 

IV. STUDENT PROGRESS CHART 

V. PROBLEM STUDENTS 

A. Cheating 

B. Procrastinators 

C. Poor Students 

D. Foreign Students 

E. Belligerent Students 

VI. COURSE WITHDRAWALS 

VII. REPORTING INFORMATION ACOUT 

YOUR STUDENTS ... 

VIM. PREPARING FOR PROCTOR MEETINGS 

IX. CONCLUDING REMARKS 

APPENDICES 

A. Testing Guidelines, Procedures, and Record 
Books 

B. Weekly Report of Student Progress 

C. instructor Duties: Monitoring Proctor 
BehavJor 



Guidelines for tiie design of personalized 
system of Instruction 

The initial steps of task analysis, Ueriving objec- 
tives, arranging them into units, locating different 
instructional materials, and keying them to the ob- 
jectives have been discussed earlier. Here arc some 
additional steps: 

□ Devise a strategy for running the system. It 
should iiKlude procedures for recruiting, testing, 
and reinforcing proctors, guidelines for taking tests 
and retaking them, and policies for obtaining a final 
grade. It is essential to come up with a plan that 
can be transferred to other teacher-training institu- 
tions if the system is to receive md^ dissemination. 

□ Write a manual for the teacher trainee. The in- 
troductory section should describe the policies and 
procedures for the course. Specific study guides for 
each unit should include objectives, reading lists and 
other instructional materials, a brief outline of the 
unit, supplementary readings, and a set of study 
questions. 

□ Write a manual for proctors. The following ex- 
ample shows the tabic of contents from Born's 
(1970b) Proctor Manual indicating the different 
topics to be discussed. 



Table of contents from Proctor Mariual (Born, D. C. 
1970) indicatino range of topica discussed. Reprinted by 
permission. 



S6l0Ct«d btbltography 

on mattory^learnlng formata 



Adjunct programing 

Pressey, & L. Development and appraisal of de- 
vices providing Immediate automatic scoring of 
objective tests and concomitant self Instruction. 
In A. A. Lumsdaine and R. Olasor (Eds,) Teach' 
log mBchlnes and programed learr)lng: A source 
book. Washington, D. C: DAVI/NEA. 1960. (This 
sourcebook also contains other interesting ar- 
ticles on adjunct programing.) 

Scoring devices 

Instruction manual for the Rapld-Rater. Syosset, 
N. Y.: Research Media, Inc. 1964. 

Manual of concealed Image response techniques. 
Mount Vernon, N. Y.: Eifective Learning Inc., 
1972. 

Repeated teating 

Bloom, B. S., Hastings, J. T., & Mandaus, G. F. 
Handbook of formative and summatlve evalua- 
tion of student learning. N. Y.: McGraw-Hill, 
1971. (Read especially Chapter 3 on learnino 
(or mastery a»id Chapter 6 on formative evalu* 
atlon.) 

Okey, J„ & Ciesia, J. Teaching for mastery. Bloom- 
ington, Ind.: National Center for the Develop- 
ment of Training Materials In Teacher Educa- 
tion, Indiana University, 1972. 



Peraonallzed Inalructlon 

Personalized system of Instruction: An alternative, 
film, 16mm, black and white, 13V2 minutes. 
Lincoln, Neb.: University of Nebraska ln<>truc- 
tional Media Center* 1972. 

Born, D. Q. Instructor manual for development of 
a personalized Instruction course. Salt Lake City* 
Utah: University of Utahi Center to Improve 
Learning and Instruction, 1970. 

An excellent set of practical guidelines on the 
design of personalized systems of Instruction. 

Ferster, C. B,, & Perrot, M. C. Behavior principles. 
N. Y.: Appteton-Century-Crolts, 1968. 

A textbook bdsecH on the personalized Instruc- 
tion format. 

Born, D. G. Proctor manual. Salt Lake City, Utah: 
University of Utah, Center to Improve Learning 
and Instruction, 1970. 

A good example of a proctor's manual. 
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Chapter 13 

SelMnstructional print formats 



Objectives 

1 . Give examples of the self-instructional print 
format and Hst their common features, 

2. Prepare a handout on a suitable Instructional 
topic using appropriate Instructional deslgri 
features. 

3. Prepare different types of information maps re- 
lated to a suitable instructional topic. 

4. Develop a programed instructional module on 
a suitable Instructional topic. 



The three formats described in this chapter consist 
of printed materials designed for use by individual 
teacher trainees. The major difference among the 
formats is in the amount of control exerted over the 
trainee's study behavior. The first format is the tra- 
ditional textbook, which continues to be one of the 
most effective and flexible instructional formats, 
but which does not exert too much control over the 
reader's behavior. The second format, instructional 
mappings is still evolving as a technique for effi- 
cient organization of instructional information for 
both initial learning and quick reference. It uses a 
tightly structured formal but allows the teacher 
trainee considerable freedom. The third format, 
programed instruction, requires active involvement 
of the teacher trainee and controls the sequence and 
the method by which he learns. 



I. Textbooks and directives 



In spite of its obvious limitations, the textbook 
can be considerably improved through the appli- 
cation of systematic instructional-development proc- 
esses. Although few readers may be planning to 
write an entire text in the near future, the same ap- 
proaches are useful for preparing directives. 

One of the major student complaints about text- 
books is their lack of relevance to classroom prob- 
lems. Texts could be made more relevant if they 
began with analyses of the teacher's tasks and the 
concepts related to the teaching of exceptional 
children. A number of effective elemehts from other 
instructional formats c^n be adapted for use with 
textbooks and directives. For example] each chap- 
ter of the text could begin with a set of 'objectives 
and end with criterion-referenced test questions. 
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The instructor's guide lo the textbook could suggest 
various Innovative management formats. Texts are 
easily adaptable for use with personalized systems 
of instruction and mastery-learning formals. 

Textbook writers, by reputation, are verbose and 
formal, perhaps because the skill and innovation 
required to write a succinct text in the target-trainee's 
language are not easy to acquire. Fortunately^ most 
current textbook authors are discarding the tradi- 
tional approach and talking directly to the teacher 
trainees. Textbooks and directives can also be made 
more efficient through the use of a number of learn- 
ing aids: charts and tables, summaries, expanded 
tables of contents, headings and subheadings, typo- 
graphical cues, illustrations with explicit captions, 
references and bibliographies, glossaries, and 
indexes. 

Textbooks and directives should be tried out and 
revised just as any other instructional material. A 
teacher trainer may start with a series of directives 
for his course and request the trainees to make com- 
ments and suggestions on their copies and then to 
exchange them for clean ones at the end of the 
semester. After suitable revisions, the new version 
can be tried out on the next class. When trainee 
feedback becomes consistently positive, the materials 
can be assembled as a textbook for final publication. 
Some useful guidelines on textbook publication and 
effective writings are listed in the selected biblio- 
graphy at the end of this chapter. 



11. Information mapping 



Information mapping is a new and still-evolving 
format for the design of printed instructional ma- 
terials. It is especially applicable to the preparation 
of teacher-training handovts in special education. 
In this technique, units of instructional content are 
classified into concepts, structures, processes, pro- 
cedures, classifications, facts, or proofs. Each type 
of content has a standardized presentation format 
called a map* A map is made up of different units 
called blocks. The following example of a concept 
map includes the name of the concept^ an introduc* 
tion, three examples, a definition, two nonexamples, 
a notation, and related map blocks. A procedure 
map, to give another example, has the name of the 
procedure, procedure table, flowchart, occasion for 
starting, when to stop, decision table, checklist^ and 
worksheet blocks* Rules for writing the blocks and 
assembling them into maps are based on principles 
of instructional design and learning theory. Single 
maps may be used as directives. For larger sections, 
the maps are assembled into units and the units into 
courses. Other unique features of the information- 
mapping format include marginal labels, uniformity 
of headings und subheadings, local indexes in each 
map, and feedback questions. 



Er|cio2 



Introduction Now that we understand the nature of a concept, wo are ready to deal with those 

cognitive demands which require the learner to relate two concepts. 



Exampio one 


Teacher: MeredKh. what is the differehce between a square and a rectangle? 


Example two 


Teacher: Lynn, could you tell me how a square and a rectangle are alike? 


Example three 


Teacher: To find the area of a square all we do Is to take the length of a side and 


multiply it by itself. Karin, what is the area of a square whose side 




Ia 4A fool \f\nn*y 


DeKnitlon 


An applying-comparing cognitive demand Involves rules anif concepts. It may take 








• comparing different concepts 




• contrasting different concepts 




• explanation of how rules apply to concepts 




• application of a rule 


Nonexampte 


Teacher: Rente, could you tell me the difference between this boltte and the one on 




the table? 




This is not an applying-comparing demand since actual objects (not 




concepts) are being compared. 


Nonexample two 


Teacher: If you were trapped in the middle of a tropical forest, what would you do. 




Mike? 




This goes beyond direct application of a single rule but rather is a whole 




problem-solving situation. 


Notation 


In the Individual Cognitive Demand Schedule, applying-comparing demands are 




coded as AC. 


Related map^ 


The following related maps deal with other categories which involve concepts 




and/or rules: 




defining-classifying, 32 




inferring, 58 




problem solving, 64 



An example ot a concept map, based on Lynch 

and Ames (1971), tndividual cognitive demand schedule. 



Guidelines for the design of infonnstion- 
mapped materials 

An outline for designing iiiformaUon maps fol- 
lows. More dciailcd procedures can be found in 
Horn, NiCol. Raxar» and Kleinman (1971). 

□ Divide the lesson content into different units. 
Classify the type of information for each unit into 
one of the seven categories of information maps. 

□ \vrite suitable information maps for each unit. 
Use graphic aids (tree diagrams, comparison and 
contrast tables, summary tables, prerequisite charts) 
to present the information with maximum clarity. 

□ Arrange information maps into a r.nit. Jnterre- 
lale them through cross references. 

□ Design suitable feedback questions and place 
them in appropriate locations. 



III. Programed Instruction 



Some educators have written off programed in- 
struction as a viable instructional format at the level 
of teacher training; others are excitedly reinventing 
it. Programed instruction has come a long way from 
small-step frames and zebra-striped books and it 
has an important role in the training of special ediv 
cation teachers. It is especially suited for instruc- 
tion in fundamental skills and knowledge. Ho 'ever, 
exclusive use of programed instruction over long 
periods of time is not recommended. 

Examples 

The succeeding examples are pages from two 
different programed instruction manuals. The teach- 
er-trainee goes through various frames of the pro- 
gram that present segments of information. Each 
frame also poses a question and requires the learner 
to respond actively to it. Only after making his re- 
sponse does the teacher trainee look at the correct 
response given in the program. Later frames pre- 
sent additional new information, relate it to the in- 
formation previously learned, and lead the trainee 
toward the mastery of all objectives. 

This type of programed instructional material is 
generally labeled "linear.'* In another type called 
"branching," the teacher trainee is referred to dif- 
ferent frames, depending upon his choice of answer 
to the question in each frame. In the new frame, 
following a correct choice, he is complimented and 
presented with the next piece of information and a 
new question. Following an incorrect choice, he is 
sent to a remedial frame that explains his error and 
then back to the original frame for another try at 
answering the question. 
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A sampJe page from a selMnstructlonal program: Harless, 
J. H.» and LIneberry, C.^.Tuming Ms on and off (1971). 
Reprinted by permlsslOD. 



Part III: Contingency managemeni, a motlvatlonat 
tyitem 

As you drive throi>gh ihd community on your way home 
after school, or on a Saturday morning, you observe 
your students engaged in a variety of leisure-time ac- 
tivities. Some are p[ayir>g ball on the corner lot. some 
are bIcycMng, a group hos gathered In front of the Ice 
cream Shop lo talk, another group Is busy working on 
their cars at the gas station. Others are to be found 
working part-time iobs, reading comic books in the drug 
store, or "just hanging around/' What accounts for dif- 
ferent students engaging in varying leisure-time activities? 



1. Kids are easily bored and move from one activity 
to another. 



a 



2. The activities described are aH enjoyabte to kids, a 

3, When given a choice. Kids would rather do some 
things man others. 



The point Is so obvious that you probably never bothered 
to recognize it Qiven a choice, kids would rafter do 
som0 things ih$n oth^rs^ No. 1 is troe, as we shall see; 
their preference in activities changes. No. 2 is inaccurate 
because it rules out individual preference. The boys 
working on their cars may consider the baseball game 
on the corner tot distinctly unpleasant ar^d vice versa. 

So what? 

Let's focus on one student. It's midmorning, Saturday, 
and as you drive to the shopping center, you notice Jeff 
hard at work mowing the lawn. Select the hypothesis 
that you think best accounts for Jeff's behavior. 

t. Jeff is mowing the lawn because he enjoys it. 

2. Jeff is mowing the lawn because he is bored. 

3. Jeff is mowing the lawn because his father told him 
if he did, he could use the car for his date that 
night. 
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A sample page from a programed manual. Modifying 
classroom behavior, Buckley. N. K., and Walker. H. M., 
1970. Reprinted by permission. 



Research studies by Eysenck 
(1952. 1960) and Levitt (1957. 
1963) have shown that traditional 
methods of psychotherapy are no 
more effective than the passage 

of In producing 

behavior — ^ 



Time 
Change 



Behavior change is defined as an 
o^servab/e alteration \r\ overt 
behavior. A shift in a child's emo- 
tional state (would, would not) 
be defined as behavior change. 

Behavior change is not represented 
in the example (in #2) above 
because there was a shift in the 

child's stale which 

(is, is not) an obsct-vabte change 
in . behavior. 

Research studies have demon- 
strated that while internal feeling 
states exercise control over some 
human activities, they are not 

predictors of 

changes in overt behavior. 



woutd not 



emotional 
is r>oi 
overt 



effective, 
reliable, 
good (Of) 
valid 



Conversely, research has shown 
that environmental events such as 
reinforcing and aversive stimuli 

exercise powerful 

over overt behavior. 



control 



While some boys probably do enjoy lawn-mowing on 
Saturday morning, they probably represent a minority. 
If Jeff were bored, he would probably seek an environ- 
ment where activities more in line with his preference 
were available. No. 3 Is the most logical of the hypotheses 
presented. If Jeff mows the lawn, then he may use the 
car for his date that night. 

That's Contingency Management 



8oi0ctod bibliography 
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Guidelines for the design of programed 
Instructional materials 

Assuming*thai you have derived a set of specific 
behavioral obj.Tiivcs, here is an ouUine for design- 
ing a self-instructional prograni: 

□ Write a criterion frame to check the attainment 
of each specific instructional objective. Arrange the 
criterion frames in a sequence suitable to forming 
an outline for the program. 

□ Write a series of leaching frames to lead the 
teacher trainee fronv his entry behavior to the per- 
formance required in the first criterion frame. Close 
the gap between this criterion frame and the next 
one with another sequence of teaching frames. Con- 
tinue this procedure until you have enough sequences 
of teaching frames to enable the teacher trainee to 
respond correctly to all criterion frames. 

□ A teaching frame should be relevant to the next 
criterion frame. It usually presents some informa- 
tion and asks a question based on it. The question 
should be worded in such a way that the correct 
response requires more thought than merely copy- 
ing the information. It should be a critical question 
that forces the teacher trainee .to attend to all im- 
portant elements of the information and to process 
them mentally before coming up with the answer. 

□ The initial version of the program should be kept 
lean by using jo.st the minimum estimated number 
of teaching frames. This practice enables us to find 
the need for additional frames during tryouts--a 
task easier than that of locating excess frames. 



Toxlbool(t and Direetlves 

Author's guWe. Worthlngtohi Ohio: Charles A. Jone&, 
1966, 

Ollbert. M. B. Clear writing. N. Y.: John WHay, 1972, 
TIchy, H. J. Ettectlvo writing. N, Y.? John Wiley, 1967. 

Information mapping 

Horn;R. E^, Nicol, E; H.r Raxar, & Klelnman, J. C. 
A referenco collection of rules and guidelines for 
writing Infornteffonniappedmeterld^^ Cambridge, 
Mass.: Information Resources, 1971. 

Proflraming 

Bullock, D. H., & Wilson, W. Creating programs for 
self-Instruction. Washlnston, D.C: Center (or 
Educational Technology, Catholic University of 
America, 1972. 

Bullock, D. H., & Wilson, V, Bdtting and revising 
programs for self-Instruction. Washington, O.C: 
Center for Educational Technology^ Cathoi Ic 
University of America; 1972/ 

Markte, S. M. Good frames and bad: A grammar of 
frame writing (2nd ec(.). N; Y.: John Wiley, 1964,, 

Pipe, P. Practical programming. N. Y,: Holt, 1966. 

Thiagara)an, S. The programming process: A 
practical guide. Worthington, Ohio: Charles A. 
Jones, 1971, 
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Chapter 14 

S0tMn«tructlonal multimedia formats 



Objoclives 

1. Give examples of setf-lnstfucllonal mulUmedia 
mattjriala In teacher training and ttsl important 
features of this format, 

2. Design an audlotutorlal module on a suitable 
Instructional topic. 

3. Design a multimedia module on a suitable In* 
structlonal task. 

4. Design a minicourse on a suitable instructional 
task. 



ERIC 



Three self-instructional formats that depend primari- 
ly upon non-prlnt media are described and discussed 
in this chapter. Audiptutorial modules use audio 
tape to guide the irainee*s interaction with instruc- 
tional materials. Multf media modules present in- 
struction through both yisuals (slide» filmstrip, or 
transparency) and audio tape. Minlcourses use film 
and video tape to involve the trainee in observing a 
model lesson, teaching, self-evaluationi re-teacliing, 
and re-evaluation. 



1. Audlotutorlal modute$ 



Originally conceived of by Postelthwait and his 
associates (1959) for undergraduate biology courses, 
the audlotutorlal format has since been used in a 
variety of situations, including the training of spe- 
cial education teachers. The format (or its minor 
variants) is also known by such labels as modular 
instruction and minicourse. The term **audiotutorial" 
clearly indicates the major feature of this formal: 
a one-to-one tutorial approach in which audio tape 
is the integrating eiemenl. 

An e*{ample of an audiottitorial module 

An audlotutorlal module on instructional games 
for handicapped children, developed at the Center 
for Innovation in Teaching the Handicapped, serves 
as our example. The trainee sits in a carrel and 
turns on a tape recorder. The module begins with 
an audio taped welcome followed by information on 
various instructional materials in the carreL Then 
the tape invites the trainee to inspect a study guide 
containing diagrams, directions for various activities, 
a glossary, and a list of references ori Instructional 
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games. When the narrator provides a rationale for 
the use of the games with menially retarded chil- 
dren, he directs the teacher trainee to turn on a slide 
projector and view a group of handicapped children 
learning from a game. He outlines a procedure for 
developing learning games. The trainee has an ac- 
tual game board in the carrel and is given a step- 
by-step description of its development. This de- 
scription is illustrated with slides. The steps in game 
development are also listed in the study guide. Then 
the trainee is asked to leave the carrel and to de- 
velop his own learning game. When he returns with 
a prototype of a game» the tape narrator asks a 
series of evaluation questions and suggests various 
ways in which potential problems can be eliminated. 
An explanation is given of how a game is tried out 
with children and the procedure is illustrated on 
slides. The trainee leaves the audiotutorial module 
ready to modify his game and test it with children. 
He takes his study guide with him as a reference 
source since it contains his notes in addition to the 
various checklists. 



Guidelines for the design of audiotutorial modules 

□ With an approximate idea of the objectives, write 
a rough script for lh(* audio tape. Let other trainers 
go through the script to check its relevance and 
accuracy. 

□ Analyze the content of the script to derive re- 
vised objectives for instruction. Construct a criterion- 
referenced lest based on these objectives. 

□ Select suitable instructional media and activities. 
The media may include real objects, models, slides, 
film loops, printed pictures, and text. The activities 
can include listening to the tape, reading the guide, 
completing assignments, examining specimens, and 
solving problems. 

□ Plan a tentative sequence of instructional con- 
tent and activities. 

□ Collect such existing materials as film loops, 
real objects, and booklets. Prepare additional ma- 
terials as required. Also prepare a rough draft of 
the study guide for the teacher trainee. This booklet 
should include all photographs, diagrams, tables, 
and checklists and it should provide space for note- 
taking. 

□ With a tape recorder, instructional materials, 
study guide, and Ihc objectives in front of you, pre- 
pare a rough tape. Remember that the trainee must 
be actively involved all the lime. Take an imagin- 
ary student through the module or work with an 
actual teacher trainee. 
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tJ Transcribe the rough tape and edit it. Wifh the 
edited transcript and instructional materials, pre- 
pare a revised t^pe. Retape and transcribe the mod- 
ule using a professional voice if necef^sary. Also 
prepare multiple copies of the study guide. 



□ Set up the completed audiotutorial module in a 
carrel for evaluation by subjcct-ntalter experts, edi- 
tors, and trainees. Modify the module on the basis 
of their comments and suggestions. 

Suggestion for further reading 

Postelthwait, S, N., Novak, J., & Murray, H. T. 
The ouJioMorial approach to teaming, Min- 
neapolis, Minn.; Burgess Publishing Co., 1969. 



IL Multimedia modules 



Multimedia modules use projected visuals (slide, 
transparency, or filmstrip) and audio tape. Many 
media-equipment manufacturers now sell compact 
units which have a small television screen and which 
automatically synchronize a slide (or filmstrip) and 
cassette tape. Although these devices are very use- 
ful in a learning carrel, any regular projector and 
tape recorder combination can be used. 

Guidelines for the design of multimedia modules 

Prepare an outline of specific instructional ob- 
jectives for the module. Select suitable media for 
each unit of instruction based upon these objectives 
and learner analysis. For details of media selection, 
-jee (Thapter 8. 



□ Prepare an outline for the module, indicating 
the visual or auditory mode for different sections of 
the materials. Check this outline for any interfering 
combinations. 

□ Design visual and au Jitory messages to take the 
fullest advantage of the intrinsic qualities of the 
media. For example, it is better to record spontane- 
ous oral instructions to a trainee from an actual en- 
counter than to use a written script. 

□ Involve teacher trainees in the testing of the 
modules as early as possible. Test visuals to see if 
they clearly present the message. Add captions and 
auditory narration as needed, Use less expensive 
media to simulate the final product during initial 
stages of tryout and revision, that is, paper visuals 
instead of slides or video tape instead of film. Try 
out each component separately. After preliminary 
modification, test the combination to make sure all 
components are smoothly integrated. 

Suggestions for Further Reading 

Briggs, L. Campeau. P. L./Oagne. R. M , & 
May, M. A. ImirucHonal media: A procedure 
for the design of multi^fnedia Instruction, a cr iti- 
cal review of research and suggestions for future 
research, Pittsburgh: American Institute for Re- 
search, 1967* 

Langdon, D. O, Media messages on their own terms. 
Educational Technology, I972» 12, 39-42. 
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lit. MMc6ur$M 



Minicourse is the name givea to a teacheMrainlng 
material format developed by Borg (1970a) and 
his associates around the microteaching technique. 
A number of successfully tested minicourses are 
available for inservice and preservice teacher train- 
ing. Although none is specincally designed for use 
with teachers of handicapped children, many of 
them deal with generic teaching skills which can be 
applied to any teaching situation, The format itself 
has great potential for the development of Special 
educution teacher-training materials, particularly 
when the Instructional task involves specific class- 
room teaching skills. 

An example Of a mtnicourse 

Minicourse I (Borg, 1970a) Is devoted to the de- 
velopment of effective questioning skills in class- 
room discussion. Its first component is an introduce 
tory film that serves as a motivating device and 
specifies the instructional objectives in terms of 
skills to he learned. An instructional f ijm presents 
segments of the particular skills being used in a 
classroom situation. A model film shows a teacher 
using these skills In a brief lesson involving a few 
pupils ( a microteaching situation). This film pro- 
vides a clear model of the application of the skills 
and requires the student to identify those skills as 
they occur in later segments. The film also provides 
immediate feedback for this discrimination training. 
The teacher trainee evaluates the model lesson with 
a form from the Teachers' Handbook. 

The trainee next plans a 10-mlnute lesson using 
special forms in the Handbook. He teachers the les- 
son to a small group of learners, and incorporates 
the skills he learned This lesson is recorded on video 



tape and replayed Immediately upon completion. 
The trainee now undertakes se)f-evaluation, using 
microteaching evav r Ion forrt|s, and he pays special 
attentiort to the frequency and^quality of the skills 
taught in the package. Based on this self ^evaluation, 
the trainee reteaches the lessoii to another group of 
pupils. The re-taught lesson is also recorded on 
video tape and subjected to another self-cvaluatlon. 

After completing this scqueoce, the trainee un- 
dertakes a systematic set of follow-up activities in 
his classroom to help him review and improve his 
on-the-job skills. 

liuideltnes for the des^it of mlnlcourses 

The guidelines for the development of minicourses 
shown on page 111, are reprinted from The mini- 
course: a microteaching approach to teacher edu- 
cation {Borg cidl., 1910). 

Su^estlons for further reading 

Borg, W. Guidelines for the development of 
minicourses. Berkeley, Calif.; Far West Labora- 
tory for Educational Research and Development, 
ERIC document number ED 053 091 (n.d.). 

Borg, W. R., Kelley, M, L, Langer, P. & Gall. M. 
The minicourse: a microteaching approach to 
teacher education, Beverly Hills, Calif.: Macmil- 
lan, 1970. 



The Major Steps In the Oevetopment Cycle 



1. 


Research and Data QatherlnQ 


Includes review of literature, classroom observations, 
and preparation of report Oft the state of the art 


2. 


Planning 


Includes definition of si^ilts. statement o( oblectives, 
determination of course sequence, and small-scale 
feasibility testing. ^ 


3. 


Developing Pfelimlnary Form of Product 


Includes preparatior> of Instructional and model lesson^ 
handbooks, and evaluation devices. 


4. 


PreMmlnary Field Test 


Conducted by Laboratory personnel In one, two, or three 
schools, uetng between six and twelve teachers. Includes 
collection and analysts of interview^ observational, and 
questionnaire data. 


5. 


Main Product Revision 


Revision of product as suggested by preliminary field 
lest results. 


6. 


Main Field Test 


Conducted by Laboratory personnel in between five and 
fifteen Schools using between thirty and one hundred 
teachers. Includes collection of quantitative data on 
teachers' pre- and post-course performances, usually in 
the form of classroom videotapes. Results are compared 
with course objectives. 


7. 


Operational Product Revision 


Revision of product as suggested by the main field test 
results. 


6. 


Operational Field Test 


Conducted by regular school personnel In between ten 
and thirty schools, using between forty and two hundred 
teachers. Includes collection and analysis of Interview, 
observation, and questionnaire data. 


d. 


Final Product Revision 


Revision of product as suggested by operational field 
test results. 


10. 


Dissemination and Distribution 


Reports at professional meetings, in journals, etc. In- 
cludes work with publisher who assumes commercial 
distribution, and monitoring of dlslrlbution to provide 
quality control. 



Qw/de//nes for the design of mlnlcoursos. Borg, W. R., 
Kelley, M. L., Langer, P., & Qall, M. The mfnicoune: a 
microtoaching approach to teacher educatlor). Beverly 
Hills, Calif.: Macmillan. 1970. p. 54. Reprinted by 
permission. 



Chapter 15 

Formats for smalNcroup learning 



OblocUvds 

h Giv6 examples of teaoheMraining materials 
whfch are used by small groups and list the 
important features ot this format. 

2. Design a roleplay exercise on a suitable in- 
structional topic. 

3. Design an instructional game on a suitable in- 
structional topic. 

4. Design a simulation on a suitable Instructional 
topic. 



The formats described in this chapter are designed 
for use by small groups of teacher trainees. Their 
instructional effectiveness deper ds upon Interac* 
tlons and discussions among the members of the 
group. Although few of these formats have been 
used extensively In the training of teachers of ex- 
ceptional children, their potential is great* 



I Roleplay 



Roleplay is an effective technique for actively 
involving teacher trainees in the dramatization of 
different interactions between themselves and the 
exceptional child, parent, or administrator. Through 
roleplay, trainees may acquire appropriate inter- 
personal skills, teaching techniques, empathy, and 
flexibility. Roleplay formats range widely, from 
psychodrama to charades. 

An example of roleplay 

A simulatiott program for iraMng teachers in 
behavior management (Fink, Briggs, & Thiagarajan, 
1 972) uses a number of roleplay exercises. Each 
session involves a small group of five teacher 
trainees and each is programed by an audio tape 
and a booklet. In a typical segment, a few warmup 
exercises are followed by the assignment of roles. 
The participant with the role of the teacher picks 
up a card with these instructions: 
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This session Is on the use of demeaning 
criticism. 

Pcmeafiing criticism is the psychological 
degradation of pupils with verbal attack^ criti- 
cism or sarcasm, e.g., **I suppose you think 
you are being clever." 

Teach a simple elementary-school lesson of 
your own choice* When your pupils misbe- 
have, get angry; be nasty and critical; be sar- 
castic and insulting; don*t let them gel the 
better of you. 

Use demeaning criticism as many times as 
possible. 



The card to the player with the role of a "deviant" 
pupil has these directions: 



Another trainee plays the role of a "good" pupil 
The remaining two trainees act as observers and 
take notes on the players* behaviors. 

Each roleplay session lastsll^v^ Roles 
are changed for each session so that all participants 
play all roles. After roleplaying, the feelings and 
emotions that accompany the use of a specific con- 
trol technique are discussed. The total package takes 
about 20 hours and covers different behavior control 
techniques and their emotional consequences. 

Guidelines for the design of rolepla} exercises 

Roleplay exercises of this type have two com- 
ponents: content and opcratioa. The former reflects 
the learning task and the latter controls the mechanics 
of assignin;> roles and scheduling the sessions. It is 
useful to put the content on separate cards or in a 
booklet and the operations on audio tape. The tape 
recording also serves as a timing device. 



Misbehave frequently during this session. 

During the five-minute period change over 
from being mildly disruptive to being insulting, 
aggressive and abusive. Make the teacher get 
mad at you. 



□ Design a set of roleplay exercises that involve 
the affective aspects of your task analysis. These 
exercises should revolve around critical situations in 
the everyday life of a teacher of exceptional chiU 
dren. Have them edited by other teachers for au- 
thenticity and clarity. The final version of each 
exercise should contain a description of the teach- 
ing situation, elements of interpersonal confronta- 
tion, and specific directions for the teacher and the 
pupils. 

□ List a set of open-ended questions for discussion 
after the roleplay sessions. These questions should 
be based upon the aspects of the roleplay which are 
of instructional iniportance. 
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□ Work oul the mechanics of assigning roles and 
scheduling sessions. Prepare an audio tape recording 
to coordinate the roleplay. This tape assigns and 
reassigns different roles to different menibers of the 
group, refers them to appropriate sources for in- 
struction, tiiaintalns time limits, and provides nec- 
esst^ry cues. 

□ Test the roleplay exercise? with teacher trainees. 
Organize a small rolepiay group and have them 
work th rough the material Evaluate the clarity of 
instructions and suitability of session length. Moni- 
tor the post-roleplay discussion for suggestions on 
useful questions to be included in the discussion. 

□ Modify the package on the basis of the feedback 
from the tryout. Retest the materials until your in- 
structional objectives are consistently attained. 

Suggestion) for further reading 

ChesJcr, M., & Fox, R. Roleplaylng methods in 
the classroom. Chlcjigo: Science Research As- 
sociates, 1966. 

Lehman, D. L Roleplaying and teacher education: 
A manual for devehping Innovative teachers. 
Washington, D. C: The Commission on Under- 
graduate Education in the Biological Sciences, 
1971. 



11. Instructional games 



Instructional games are effective for both low- 
and high-level cognitive learning: They add moti- 
vation to the former and provide realistic structure 
for the latter. Games also enhance the attainment 



of altitudtnal objectives. The use of instructional 
games In the preparation of teachers for exceptional 
children has yet to receive the attention It deserves. 

An example of an instruetlonBl game 

A series of table games called ANTICIPATION 
(Semmei, 1971) assists teacher trainees to induce 
generalizations about the behaviors of different 
types of mentally handicapped children in varied 
situations. The first game in this series is played 
by two opposing teams using question cards such as 
th*; examples on the following page. 

One side of the card contains a question as It is 
presented to the children, the other side contains 
a table of percentages of correct responses by chil- 
dren grouped by age and 10 level The tables are 
based on empirically derived normative data (Meyeh 
& Hieronymus, 1970). The questions cover the 
areas of language, arithmetic^ arid work/study skills. 
The first team chooses a card, reads the questipji, 
arid estimates the percentage of children of a spe- 
cific age and 10 group (e.g., U-year-old low edu- 
cables) who would probably give the correct re- 
sponse to that question. The opposing team the 
option of challenging this estimate. Whichever tCiim 
is closer to the actual percentage on the table wins 
the round and places a Counter on a tic-tac-toe grid. 
The goal of the game is to get three counters of the 
same team in a straight line. 

During this and other ANTICIPATION games, 
players are exposed to regular patterns of behavior; 
they make up their own generalizations, discuss 
them with their teammates, test them against the 
data, and revise them on the basis of feedback. 



language Skills: Spelling 



Find the spelling mistake. 



1) sixty 

2) twelve 

3) dosen 

4) quarter 



Age 



9 10 11 12 13 14 



EMR Uroup 
50-65 IQ Group 
6S'80 IQ Group 

Normal Group 



19 31 29 43 56 67 

6 22 21 37 53 32 

^3 34 32 45 57 66 

81 67 96 96 95 96 



Ouestion cards used in ANTICIPATION games. Top figure 
shows the front of the card with the question. Back of the 
card (tower figure) has a table of percentages of children 
(grouped by age and 10 levels) responding correctly to 
the question. 



Guidelines for the design of learning games 

Figure 15.1 outlines the steps in the production 
ol^an instruciional game. 

□ Step I . Conduct a task analysis. 

□ Step 2. Conduct a learner analysis* 

□ Step 3. Select a suitable game formats A num- 
ber of classical game formats are effective for at- 
taining different types of objectives. An objective 
that requires classification of objects, for exampbs 
suggests the format of the card game *'rummy/' In 
the ANTICIPATION games described above, cur* 
ricular areas interacting with three IQ levels sug- 
gested the tic-lac-toe grid. 

□ Step 4. Design bask rules. The instructional 
objective is now translated into the criterion for 
winning the game. For example, the objective for 
one of the ANTICIPATION games is for the teach- 
er trainee to demonstrate an understanding of chrono- 
logical development in arithmetic operatio ns. To 
win this game, the player must make accurate esti- 
mates of the performances of children at different 
age levels in arithmetic tasks. Based on this prin- 
cipal rule for winning the game, the detailed playing 
procedure is worked out in terms of a set of neces- 
sary and sufficient rules. 

□ Step 5. Design game equipment, Uules of play 
suggest various game equipment and materials. 
Equipment for ANTICIPATION games includes a 
game board with a 3x3 grid, question cards, coun- 
ters of two different colors, and score pads. 
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□ Siep 6. Assemble prototjpe game. All the equip- 
ment is now prepared and the rutcbook wriiien* 

□ Siep 7. Revise pro(olypegame« Although the 
final judges of a game are its ptaycrs, a number 
of game-design rules are available to help locate 
potential problems and eliminate them. Checklist 
15,1 lists some important suggestions, 

□ Step 8. Test game with teacher trainees. The 

next step is the actual tryout of the game. Begin 
by playing the game with a small group of teacher 
trainees. Obtain feedback by watching the players' 
reactions and noting their spontaneous comments 
and suggestions. Hold a "debriefing" session after 
the game to check the motivational and instructional 
effectiveness of the game. The game should be re- 
vised to strike a balance between interest and in* 
structiori. Thii process may require modifications 
in both the rules and the equipment. 

□ Step 9* Package the game. During this final 
step^ the instructional game is prepared for dis- 
tribution. AH required cqtMpmenl and materials 
shoud be conveniently arranged in a box, including 
an instruction manual to teach the mechanics and 
the strategy the game. 



0 <f 



Figure 15.1. 

Steps in (he production of an Instructional game. 
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ChecklWIS.I 

Rovisind Rules of Instructional Qames 



Make sure that the scoring system of the game 
is dearly rel^t^d to its Instructional objectives. 

Control the element of chance. H the game de- 
pends entirely upon the fall of cards or throw of 
dice» not much $cope Is given for learning. On the 
other hand, if the game depends upon skill and 
knowledge only, it becomes a test situation. 

Make the rules of play fair. Do not give any player 
an undue advantage. Permit fair competition be- 
tween players of varying abilities with some handi- 
capping arrangements. 

Keep all players involved all the time. During 
each round of the game, require all players to par- 
ticipate. Avoid rules that eliminate a player from 
the game as a penalty. 

Keep each round of the game as brief as pos- 
sible. This principle permits the game to be played 
repeatedly within a short period of time. 

Simplify the rules of the game as much as pos- 
sible. Avoid irrelevant embellishments, 

Suggestions for further reading 

Two us|ful books on instructional games: 
Abt, C. ^/tous games. N. Y.: Viking Press, 1970. 

Gordon, /\. K. Games for growth, Chicago: Science 
Research Associates, 1971. 

A *'how-to" article on instructional games: 

Thiagarajan, S. Design, development and valida- 
tion of instructional games. Improving Human 
Performance: A Research Quarterly^ 1971, 10(10). 

A simulation game on the design of games: 

Thiagarajan, S, The GAMEgame. Bloominglon, 
Ind.: Center for Innovation in Teaching the 
Handicapped, Indiana University^ 1972. 



III. Simulations 



Simulations create situations that are analogous 
to certain aspects of reality. They require the teacher 
trainee to behave realisticatly in those situatioris and 
they provide him with feedback that reflects real- 
life consequences. However, simulations differ from 
reality In two important aspects: They are largely 
replicable and the amount of risk involved is neg- 
ligible. In the training of teachers, simulation may 
be used both for instruction and for evaluation. 
Simulations act as a bridge between methods courses 
and the real classroom. They are especially useful 
when the instructional objectives are attitudinal or 
emotional. 

An example of simulation 

Broadbent and Meehan (1971) described a simu- 
lation workshop of approximately six hours* duration. 
The target trainees were Inservice teachers from 
regular classrooms. The objective of the simulation 
was to increase their awareness of different types 
of learning disabilities, willingness to seek ancillary 
help, and motivation to initiate remedial programs 
in the classroom. The participants assumed the role 
of a third-grade teacher who is reflecting upon the 
events of the first half of the school year. Each 
participant was provided with a folder containing 
the class pictures of 24 children, class list, achieve- 
ment test scores, reading levels, 10 scores, and 
teacher comments. In the class were eight children 
with learning problems resulting from the lack of 
sequential instruction or the presence of slow* 
learner characteristics, hyperactivity, auditory 
perception, visuat-motor factors, visual-perceptual 
factors, emotional handicaps, or cultural factors. The 
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object of the simulated exercise was for the teachers 
to identify the youngsters with learning disabilities. 

The players watched a video tape to become 
familiar with the children. They were required to 
identify and list those with possible learning prob- 
Jems and they were encouraged to compare notes 
with each other and to discuss various clues indi- 
cating such problems. At the end of this stage, 
additional information on the eight children was 
distributed in the form of cumulative record folders 
and studenisV work. The participants were allowed 
to ask for and receive additional information from 
whatever source. They also ''administered" an in- 
formal test— the Purdue PerceptuQUMotot Survey. 
A video tape Indicated how the children performed 
on the individual tasks of the test. Through this 
, step-by-step process, the teachers identified the 
children with learning difficulties and planned suit- 
able remedial programs. 

DeslgtilAg simulation materials 

Many of the guidelines for the design of roleplay 
materials and instructional games will be found 
equally applicable to the design of simulation ma- 
terials. At the heart of the simulation is the real 
life situation or, as Twelker (1969) pointed out, 
the model or theory of reality that is being simulated. 
The following aspects of reality suggest different 
components of a simulation exercise. 

Context All simulations take place in a specific 
context. In the given example, it is a third-grade 
classroom. In another situation, it could be a special 
school. One of the essential components of a simu- 
lation package is information on the context. It can 
be provided by giving each player a printed scenario 
indicating where the action takes place. Specially 
designed protocol materials (simitar to the video 



tapes in the sample simulation) are also useful for 
setting the stage for simulation. 

Content* Simulation materials usually concen- 
trate 6n ohe aspect oH this example 
It Is the identific^ition of children with learning dis- 
abilities. In anpthe^ context; H be the alloca- 
tion 6f funds; for a budget meeting. 
It is essential that the Important elements of the 
limited problein being simulated be clearly iden- 
tified and communicated to the participants, ^uch 
as specifying the resources with which, and the con- 
straints under which^ the partlciparits are to act. 

People. Another Irnpdrtant aspect in a simulation 
is the roles of the people who must Interact with 
each other. For example, they can Ifjcl^ the teach- 
er, children, school psychologist, and administra- 
tor. In a full-blown simulation, different partici- 
pants may play different roles. Since the objectives 
for each actor often differ from those of others, the 
strivings of each person to attain his goal may gen- 
erate conflict with the perceived goals of other 
players. 

Designing an effective slmtilation package re- 
quires the clear specification of these elements. 
Most simulations can be cast In the form of games. 
As in the case of instructional games, tryout and 
modification are essential developmental steps. 

Suggestions for further reading 

Adair, C. H., & Foster, J, T. A guide for Simula- 
lion design. Tallahassee, Fla.: Instructional Simu- 
lation Design, 1972. 

Boocock, S. S., & Schild, E. O. (Eds.) Simulation 
g(Jm^5 />! /^ar/i/rt^. Beverly Hills, Calif,: Sage 
Publications, 1968. 



Twe)kcr» P. A. Designing simulation systems. Edu- 
cational technology, 1 972, 9, 64-69» 



Twelkcr, P. A., Urbach. F. G.» & Buck, I E. The 
systemQtic developrhem of Instructions An over- 
ylew and basic guide to the Uimture. Stanford, 
ERIC Clearinghouse on Media and Technology, 
Stanford University, March 1972. > 

Twelker, P» A. Instructional simulation systems: An 
annotated bibliography. Corvallis, Oregon, Ore- 
gon State University, Continuing Education Pub- 
lications, 1969. 

Zuckerman, D. W., & Horn, R, E. The guide to sim- 
ulation games for education and training. Cam- 
bridge, Mass.: Information Resources, 1970. 




Chapter 16 

Computer-based formate 



Obl^ttvos 

1. Qlvo examples or computer-assisted teacher 
training materials In special education and list 
Important features of this format. 

2^ Describe theoomputer-asslsted remedial edu- 
cation (CARE) program and Indicate Its poten- : 
tial applications to other topics In training teach- 
ers of exceptional children. 

3, Describe the computer-administered repeated 
testing (CART) program and Indicate Its po^ 
lentia! application In training teachers of ex- Q 
ceplional children. 

4. Describe the computer-assisted teacher training 
system (CATTS) and Indicate Its potential ap- 
plication In training teachers of exceptional 
children. 



Because of the extraordinary cost and technical re- 
sources required, few special education teacher 
trainers will undertake the design of computer- 
assisted instruction (CAI) materials. However, as 
CAl systems have great instructional potential, three 
computer-based formats currently in use for training 
teachers of exceptional children are described. Each 
is a computerized version of a nonautomated in- 
structional format: programed instruction, mastery 
learning, and field training. 



Exampl08 of computer^baded formats 



I. Cpmputer*aMlt(od remedial education (CARE) 

This package, developed at Pennsylvania State 
University (CartwrlghtA Mit^el, 1971), deals with 
the identification of handicapping conditions In 
children. Visual Information is presented through a 
cathode-ray screen and 4n image projector, and 
auditory information is presented through a four- 
channel, audio tape recorder. The trainee is required 
to make frequent responses as he works through the 
course. To respond to multiple-choice questions, he 
uses a light pen to touch his choice on the screen; 
for other questions, he uses an electric typewriter. 
In either case, the computer processes his response 
and comes up with appropriate feedback within a 
matter of milliseconds. 

The computer provides instruction in either t* - 
torlat or inquiry-and-simuladon modes. In the nist 
case, the teacher trainee is presented with frames 
like those of programed instructional materials. 
Based upon his response to each frame, he is given 
either regular, remedial, or enrich^ *nt material. 
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With the sophistication of the computer, extremely 
versatile branching and Individually tailored in- 
struction become possible. In the inquiry-and- 
simulaiion mode, the trainee applies his skills to 
identifying children with actual or potential handi* 
caps In a simulated first •grjide classroom. He has 
access to the children's cuniulatlve-fecord folders 
and he may ask the Computer for additional infor- 
mation, Frequently, the computer provides false 
leads; however, it explains the inappropriateness 
of a particular line of questioning before the trainee 
is led astray. 

Upon the completion of the course^ the teacher 
trainee not only acquires diagnostic skiils and con- 
cepts but he also learns to apply them in the con- 
struction of case histories and to plan alternative 
instructional strategies for different children. 



Computer-administered repeated testing 
(CART) 



One of the major tasks in the mastery-learning 
format is to develop different versions of the same 
criterion test along with an answer key for each 
vei2»ion. In many subject-matter areas this task 
could be entrusted to a computer using either of 
the following two techniques: 

h A large pool of objective items is constntcted 
and organized according to the objectives they 
measure. The computer is programed to select 
randomly an item for each objective and to print 
it out whenever a new version of the test is 
needed. It can also print out an answer key for 
use by the trainee or the student proctor. 



2. In areas where computational skills are in« 
volved, the basic form of the question is fed into 
the computer for raindom printout at appro 
priate places. The computer may also be pro- 
gramed to print out the correct response for the 
trainee or his proctor for evaluation purposes. 
Along with the answers, the computer can also 
print out the permissible range of error (e.g., 
"The correct response Is 13,79, any response 
within .50 of this figure Is acceptable'*) and in- 
termediate steps. 

III. Computer-assisted teacher trainlii^ 
System (CATTS) 



A direct and effective method of training a po- 
tential teacher is through practice teaching. Usuallyi 
however* feedback given to the trainee In a super- 
visory conference is based on vagu^^, arfAoc impres- 
sions. Objective, reliable feedback on teaching be- 
havior can be obtained and transmitted through a 
teaching observation system that categorizes and 
operationalizes the behaviors which are deemed 
relevJ»nt by the trainee and his supervisor. This ob- 
jective technique, however, requires tedious ^Jata 
analysis and incurs a delay in the feedback. 

The Computer-Assisted Teacher Training System 
(CATTS) developed by Semmel and his associates 
(1972) minimizes the problems inherent in conven* 
tional observation-coding-feedback programs. It 
enables the teacher trainee to receive relevant feed- 
back on his teaching behavior while he Is teaching 
through a feedback source located in the teaching 
environment, 

The physical configuration of different areas of 
the CATTS is shown in Figure 16.1 . 
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Figure 16.1. 

Arranoemeni of Teacher Education Laboratory for CATTS. 



The leacher trainee, either Independently or in 
collaboration with his supervisor, sets up objcclivcs 
for his teaching performance in terms of an obser- 
vation coding system. Here are some examples: 

1. There should be at least twice as much vStudent 
talk as there is teacher talic during the lesson 
as coded on the Flanders System. 

2. 1 should not use more than five memory ques- 
tions as coded on the Individual Cognitive 
Demand Schedule. 

3. I want lo vary classroom behavior control 
techniques as indicated by my use of at least 
ten different behavior management techniques 
from the IBMS during my lesson. 

The trainee teaches in a cla^room contal ling a 
television monitor under direct computer control 
for the provision of feedback. In the teaching lab- 
oratory setting, the classroom is adjacent to an ob- 
servation-coding station which has a one-way mirror 
window to permit unobtrusive observation of the 
class. In the on-site training situation, the observers 
do the coding in the classroom. The trained coder 
in the class or laboratory uses a device with ten 
mechanical pushbuttons, similar to a touch tele- 
phone, which transmits the codes to a computer in 
the analysis-encoding station. The computer proc- 
esses the coded data, stores iti and then transmits it 
in the form of an easily readable frequency table or 
a curve to the television monitor on the teacher's 
desk. 

As the trainee teaches a lesson, observers record 
the frequency and duration of relevant behavior, 
using the appropriate system. This information is 
fed directly into the computer through the push- 
button coding box. The computer processes the 
information, compares the present status with the 



trainee's goals, and feeds it back to the trainee while 
he is teaching. Using this feedback, the trainee modi- 
fies his performance to attain his objective. Re- 
peated practice teaching with Instant feedback 
should assist the trainee in developing the teaching 
style he desires and provide the training super- 
visor with objective performance data in real time. 

Suggestions for further reading 

Carlwrighl, O. P.» & Cartwright, C. A. Computer 
assisted remedial education: Early Identification 
of handicapped children. Report No. R*36. Uni- 
versity Park, Pa.: Computer Assisted Instructional 
Laboratory, College of Education, Pennsylvania 
State University. 

Meredith, J. C The CAI author} Instructor: An in- 
troduction and guide to the preparation ofcont' 
puter-assisted Instruction materials, Englevvood 
Cliffs, N. J,: Educational Technology Publica- 
tions, 1971. 

Semmel, M. I., Olson, J. R., & Weiske, W. M. An 
information and technical manual for the com- 
puter-asslsted teacher training system (CA TTS). 
Bloomington, Ind.: Center for Innovation in 
Teaching the Handicapped, Indiana University, 
1972. 

Semmel, M. I. Toward the development of a compu- 
ter assisted teacher training system. In N. 
Flanders and G. Nuthall (eds.) The classroom 
behavior of teachers, Vol. XVllI, UNESCO 
Institute for Education, Hamburg, Germany, 
1972. 
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Chapter 17 
6xp0rt appraisal 



Obl0otlves 

t Expldln th0 relation between formative evalua- 
tion and developmonlal testing of Instructional 
iriatorlals. Dlscrlmlnalo between expert ap* 
pralsdl and developmental testing In terms of the 
type of feedback received. 

2. Discriminate between technical and Inslruc- 
tionat reviews In expert appraisal. 

3. Conduct language, format, and media reviews 
of an instructional material. Modify the material 
on the basis of technical feedback. 

4. Conduct expert reviews of appropriateness, ef- 
lectlveness, and feasibility of an instructional 
material. Modify the material on the basis of 
expert feedback. 



Although the discussion of the design of the In* 
structlonal material is concludCM m thU tliC 
actual development process Is far from Complete. 
The initial version of the materials developed should 
undergo a number of modifications before being 
finalised for use by trainees. Some of the modifi- 
cations nr^ay be based on the developer*s hindsight; 
most» however, will be based ori feedback from 
others. This chapter and the following one deal with 
the collection of evaluative feedback for the de- 
velopment of instructional materials. The process 
Is called ^'formative evaluation/* that is, evaluation 
undertaken for the improvtment of the instructional 
material 

Expert appraisal is one stage of formative evalu- 
ation. It is the process of obtaining editorial feed^ 
back frorii various professionals for the Improve- 
ment of the instructional materials. Based upon this 
feedback the material is modified to improve its 
appropriateness, effectiveness, usability, and tech- 
nical quality. 

It has been suggested that the only real lest of 
instructional materials is by students. Yet, while 
performance data from student tryouts are the most 
valuable feedback for the Improverneni of such ma- 
terials, knowledgeable experts can provide feedback 
on theoretical soundness and technical quality which 
are beyond the student's realm of expertise. Further- 
more, from a dissemination t)oint of view, exnert 
opinion is most important since, for better or worse, 
the decision to adopt the material is frequently 
based upon it. 



Types of expert eppralsal 



The following figure outlines several types of 
expert appraisal. Expert appraisal may be con* 
ducted from either a technical or an Instructional 
point of view. Both types of reviews are obviously 
important for the production of high quality in- 
structional materials, although each relates to a 
distinct aspect of materials development. It is very 
unlikely that a special educator would want to pass 
judgment on the technical quality of media or lan« 
guage except from a uscfs point of view. More 
importanlly, no media specialist would feel quali- 
fied to pass judgment upon the Instructional con- 
tent. On the technical side, media review deals with 
such factors as technical quality of production and 
compatibility of materials and equipment; format 



review deals with specialized requirements of the 
instructional format chosen for the material; and 
language review is similar to editing for technical 
publications. As Lumsdaine (1964) pointed out, 
the appropriateness, effectiveness, and feasibility 
of instructional materials should be reviewed. An 
extremely effective material is of no value if the 
content or objectives are inappropriate. Similarly* 
the most appropriate material becomes worthless if 
it is impracticable. Hence, the instructional review 
of a material involves the evaluation of all three 
aspects— appropriateness, effectiveness, and feasi- 
bility. 



4^ 



Expert appraisal of ir>struc(ion materials. 




Guidelines for conducting expert appraisals 



t. Technical review 



Some useful inpuls may be obtained by requesting 
a colleague to review informally the prototype in- 
structional material. To increase the amount of 
feedback^ however, the following techniques may 
be adopted: 

□ Use a wide variety of specialists from scholarly 
and technical areas. A professional jury should in- 
clude special educators, subject-matter experts, 
language editors, and media production experts. 

□ Restrict each expert to his own field. It is a 
waste of resources to have the special educator 
point out errors in spelling or the language editor 
evaluate theoretical issues. 

□ Present only relevant parts of the instructional 
material for evaluation by each expert. There is 

no need to show the paper-and-pencil section to the 
film production expert. A special educator can 
judge the appropriateness of the content by going 
through the objectives and skimming through se- 
lected sections of the material, 

□ Specify the purpose of the review by each expert 
by defining the context in which the matc^-ial is to 
be used and by providing him with a checklist or 
questionnaire. 



Language review 

The purpose of this review is to check the ap- 
propriateness of the language for the target trainee 
population and the correctness and clarity of its 
usage. Ideally, a person with experience in editing 
special education publications should conduct this 
review. He should be provided with all verbal con- 
tents of the paclcage, including typewritten tran- 
scripts of all audio tape recordings. 

A sample checlclist for the language review 
follows: 



Checklists 
language review 



Directions: Rate the material on each of the fol- 
lowing Items by circling the appropriate number 
In the flve-p?lnt scale. In addition^ edit and re^ 
write the material as needed. 



1. 


Poorly organized 


1 


2 


3 


4 


5 


Well organized 


2. 


Ineffective use of subtieadings 


1 


2 


3 


4 


s 


Effective use of subheadinos 


3. 


Too long or too short for ttie topic 


1 


2 


3 


4 


5 


Optimum length for the topic 


4. 


Confusing 


1 


2 


3 


4 


5 


Clear 


If 

D* 


Wordy, rambling 


1 


2 


3 


4 


5 


Briefi concise 


O. 


Awkward 


1 


2 


3 


4 


5 


Fluent 


7. 


Inefficient paragraphing 


1 


2 


3 


4 


5 


Efficient paragraphing 


8. 


Technical terms left undefined 


1 


2 


3 


4 


5 


Technical terms defined properly 


9, 


Too formal or too informal 


1 


2 


3 


4 


5 


Suitable style 


10. 


Inconsistent 


1 


2 


3 


4 


5 


Consistent 


11. 


Evidence of poor proofreading 


1 


2 


3 


4 


5 


Evidence of excellent proofreading 


12. 


Too many or too few illustrations 


1 


2 


3 


4 


6 


Appropriate number of illustrations 


13. 


Illustrations are distracting 


1 


2 


3 


4 


5 


Illustrations are useful and relevant 


14, 


Not enough tables 


1 


2 


3 


4 


5 


Useful tables 


15. 


Citations and references do not 
accord with APA style 


1 


2 


3 


4 


5 


Citations and references accord 
with APA style 


16. 


Glossary needed but absent 


1 


2 


3 


4 


5 


Efficient glossary present 


17. 


Index needed but absent 


1 


2 


3 


4 


5 


Efficient index present 




Media review 

The purpose of this review is to check the tech- 
nical quality of the finished product and the com- 
patibility of the materials and equipment. The re- 
viewer should, of course, be knowledgeable in the 
specific medium used for presenting the instructional 
content Indicate the context In which the materials 
are to be used and suggest emphasis upon ways of 
improving the technical quality. With the rapid 
chanp.es in the media field, it is not feasible to come 
up ui(h a standard set of specifications or a check- 
list for this review; all technical details may be rea- 
sonably left to the expert. 

Fotmal review 

Each instructional format has its own standards 
and criteria. For example, programed instruction 
has standards for step size, error rate, and blackout 
ratio (ratio of number of critical words to total 
number of words); simulation games have standards 
for model fidelity, replicability, and ratio of play 
lime to preparation time; personalized systems of 
instruction have standards for course "calendar, study 
units, and safeguards against procrastination. As in 
the case of media, these criteria keep changing. In 
programed instruction, for example, a small step 
size is no longer customary; in simulation gaming, 
the amount of structure is decreasing; and in per- 
sonalized systems of instruction, the trainee is no 
longer given unlimited lime to finish the course* 
Obviously, this type of technical review should be 
conducted by someone who is experienced in de- 
signing instructional materials in the specific formal. 
Given only the definition of the context and the 
purpose of the review, the appraisal expert should 
be free to use his own procedures for evaluation. 



\l ln(^:7uctlonal review 



Appropriateness 

Appropriateness is the extent to whlcl) the ob- 
jectives and the content of the instructional material 
are consonant with goals of teacher tr^iining in spe- 
cial education. People qualified lo conduct an ap- 
propriateness review include special educators, 
scholars in specified areas, teacher trainers, and 
supervisors. Judgment of the appropriateness of 
content may be based upon such sources of infor- 
mation as the statement of objectives of the instruc- 
tional material, the rationale for the material as 
given in the introduction or the trainer's manual, the 
table of contents, authors* outline, and opinions and 
review of other experts. The following checklist will 
aid in structuring an appropriateness review: 
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ChocMIMs 

Appropriateness of instructional content 



Directions: Critically inspect the instructional pack* 
age and all adjunct materials. Evaluate the appro^ 
priatcness of the material with respect to the goals 
and objectives of teacher training in special edu* 
cation. Rate each item on the basis of S points for 
outstanding quality, 4 points for better than average, 
3 points for average, 2 points for below average, 
and 1 point for unacceptable. Circio the appropriate 
riumber to indicate your r^Ming. On the second 
section of this checklist please give your sugges- 
tions for improving the materials. 



1. 


Retevdnce of the stated objectives of the material to the 1 
general goals of teaching exceptional children. 


2 


3 


4 


5 


2. 


Meanlngfulness of the objectives to the trainer. i 


2 


3 


4 


5 


3. 


Meanlngfulness of the objectives to the teachor iralneo. i 


2 


3 


4 


5 


4. 


Sources from which the objectives are derived i 


2 


3 


4 


5 


5. 


Stated rationale for the objectives. 1 


2 


3 


4 


5 


6. 


Relevance of the content to the objoctives. i 


2 


3 


4 


5 


7. 


Theoretical soundness of the content. 1 


2 


3 


4 


6 


8. 


Adequacy of definitions and explanations. 1 


2 


3 


4 


5, 


9. 


Ifse of technical terms, formulae, and notations. i 


2 


3 


4 


5 


10. 


Nurriber of examples. 1 


2 


3 


4 


5 


It. 


Authenticity of examples. 1 


2 


3 


4 


5 


12. 


Competence of the authors. 1 


2 


3 


4 


5 



Checklist: 

effectlvenets of Instructional maisrlais 



Suggsstlons for modlficstlon 

1. Additional objectives to be Included: 

2. Trivial and superfluous objectives to be deleted: 

3. Suggestions for Improving the face validity of 
the material: 

4. Conceptual shortcomings and errors to be 
corrected: 

6. Minor technical errors: 

6. Examples to be added: 

7. Examples to be deleted: 

8. General suggestions for the Improvement of the 
materials: 



Effectiveness 



Effectiveness is the extent to which instructional 
objectives are attained by teacher trainees who work 
through the material. It is evaluated by t)oth infer* 
ring the potential effects and interpreting the data 
from student testing. Instructional developers pro- 
vide data on the effects of various characteristics of 
the instructional material; evaluatdrs may be asked 
to interpret performance data. It is essential to re- 
mind reviewers that the primary goal at this forma- 
tive stage is to Improve the material. The effective- 
ness checklist should be helpful in this evaluation. 



Directions: Critically inspect the Instructional pack- 
age and the «vaiuatlon report. Suggest modifica- 
tions in each of the foliowing aspects for improving 
the effectiveness of the material: 

1. Statement of objectives 

2. Tests 

3. Instructional content 

4. Level of language 

5. Style of presentation 

6. Instructional activities 

7. Difficulty level 

8* Sequence of presentation 

9. Practice and review 

10. Feedback to trainee 

11. Teacher's manual 



Poa${bllity 



Feasibility is the extent to which the material 
developed is usable for teacher training in special 
education. Personnel qualified for a feasibility re- 
view Include teacher trainers, administrators of 
teacher training programs in special education, and 
directors of media and materials centers. Their es- 
timates of the usefulness of the materals will be 
based upon such factors as cost of material^ equip* 
meni» space, and lim^ requirements, and acceptance 
by trainers and trainees. A feasibility checklist for 
use in this review is presented on page 135. 



From appraisal to revision 

The following additional resources for expert 
appraisal may be useful in the formative evalua- 
tion of material: A test construction expert should 
check the validity and reliability of the criterion- 
referenced tests, and a target trainee population 
should provide critical appraisal in addition to per* 
formance data. The developer's own hindsight on 
what he mi^ht have done differently should not be 
discounted. Not all suggestions from all sources are 
worthy of being acted upon. Contradictory sugges- 
tions from different experts are often encountered 
For example, the subject-matter specialist may ask 
for *'more precise terminology" white the language 
editor may complain of too much jargon. Expert 



appraisal does not reduce the number of decisions 
necessary; it merely presents different points of 
view. Decisions on which suggestions to act on must 
be made and then translated into actual modifica- 
tions of the material. In some cases, when drastic 
changes are undertaken^ it is a good idea to check 
back with the major appraisal experts involved iri 
the original evaluation. 
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Wi'' inttrucllonal maldrlali 



Directions: Critically inspect the instructional 
package and the trainer's manual. Evaluate the 
usability of the material in a typical special educa* 
tion course. Rate each item on the basis of 5 points 
for considerable usability, 4 points for better*than« 
average usability, 3 points for average usability, 
2 points for below*average usability, and 1 point 
for virtual unusability. Circle the appropriate num- 
^ ber to indicate your rating. 



1. Adequacy of packaging. 

2. Availabitity of supplementary materials. 

3. Reusability of the materials. 

4. Equipment requirements. 

5. Space requirements. 

6. Preparation time. 

7. Training time. 

8. Scheduling requirements. 

9. Cost. 

10. Trainer's manual. 

11. Procedure for use. 

12. Flexibility of use. 

13. Special skills required for use. 

14. Potential acceptance by teacher trainers. 

15. Potential acceptance by teacher trainees. 



2 
2 
2 
2 
2 
2 
2 
2 
2 
2 
2 
2 
2 
2 
2 



3 
3 
3 
3 
3 
3 
3 
3 
3 
3 
3 
3 
3 
3 
3 



4 
4 
4 
4 
4 
4 
4 
4 
4 
4 
4 
4 
4 
4 
4 



5 
5 
5 
5 
5 
5 
5 
5 
5 
5 
5 
6 
5 
5 
5 



Suggestions for improvement; 



Chapter 18 

Developmental testino 



Objectives 

1 , Describe different stages of developmental 
testing and explain how the Instructional ma« 
terlal Is revised at each stage. 

2. Conduct developmental testing of m Instruc- 
tlonal material, first with Individual trainees, then 
with groups, and finally under actual tralnlno 
conditions. M^ke Appropriate modifications in 
the instructional matorlats and the instructor's 
manual. 



Developmental testing involves the trying out of 
instructional materials on members of the target- 
trainee group. The purpose of the testing is to collect 
feedback to make the materials Inslructionalty and 
moilvatlonally more effective. 

Although Instructional strategies are becoming 
more and more refined, we are not yet at the stage 
of producing perfects first draft materials. Often, a 
great difference 1$ found between what experts pre- 
dict and the way trainees perform. In a frequently 
cited study by Rothkopf (1963), experisV rankings 
of Initrucllonal material? correlated hegcitlvei^ with 
student outcpmes, Thus, data from student testing 
remain the most valid predlctoffof pptentlal 
problems. 

Three phases of developiitenUil testing 

Experienced Instructional developers undertake 
developmental testing In three stages. In the first, 
the materials are tested in a fdce*to*face situation 
and revisions are made on the spot. After ellmihating 
obvious problems, ^quantitative testing of the 
materials in their "fjnar format i$ undertaken and 
further modifications are made. Finally, in the total- 
package testing, other teacher trainers are d$ked to 
use the materials under actupl training conditions 
and to suggest changes to improve the usability of 
the package. The following table summarizes these 
three stage ^ of developmental testing. 



Three stages of developmental testing. 



Stage 



Tryout 
al(uat(on 



Type of 
students 



Type of 
data 



f^evislon 



Number of 
sessions 



1. Initial 
testing 



IndWidual teacher 
trainees or small 
groups In a face* 
to-face situation 
with the Instruc- 
tional developer 



2. Ouantitatlve 
testing 



In actual training 
situation Under 
the direction of 
the instructional 
developer 



Total-pack- 
age testing 



In actual training 
situations without 
the instructional 
developer 



Selected teacher 
trainees 



Qualitative. 
Responses, re- 
actions, and 
comments from 
teacher trainees 



Some on the 
spot, others 
after each 
tryout session 



Teacher trainees 
enrolled In a 
course or work- 
shop 



Written respon- 
ses. Also 
responses to 
Cluestionnalres 



Systematic 
revisions 
based on 
data anal- 
ysis 



All teacher train- 
ees enrolled In a 
course or work- 
shop 



Responses to 
tests and ques- 
ifrvnnairs, in- 
structor comments 
and suggestions 



Revisions of 
Instructor's 
manual and 
adjunct mate- 
rials 



Four or 
five (until 
consistent 
results are 
obtained) 



One Or two 
depending 
upon extent 
of revisions 



One or two 



Initial dovolopmentat testing 



Instructional materials should be tried out with 
teacher trainees as early in the developmental proc- 
ess as possible, even in their unfinished state. Ob- 
viously, it is cheaper to modify a rough sketch than 
a finished slide. The earlier testing and modification 
begin, the easier problems can be eliminated. Also, 
during initial stages the developer is more apt to 
be objective. 

To maximize feedback, a '*lean" version of the 
material containing a minimum amount of instruc- 
tional content is used at the initial testing stage, ft 



permits the location of areas in need of additional 
instruction— an easier task than identifying redun- 
dant or superfluous content. 

Initial developmental testing is conducted in a 
clinical setting with the teacher trainee and the in- 
structional developer working together. Tryouts 
are conducted individuallyi unless, of course, the 
instructional format requires small groups. If, for 
some reason, it is not feasible for the developer to 
conduct the tryouts, the person substituting for him 
should be fully briefed on what not to do as well as 
what to do. 

The teacher iraineeo selected for initial testing 
should be enthusiastic and communicative. Being an 
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authentic representative of the target^trainee popu- 
lation i$ less important at this stage than the ability 
to verbalize problems. During the actual testing 
swion, the teacher trainee is given a copy of 
the material and asked to work through it. He 
should be reassured that it is the material which is 
being tested, not his ability. Avoid communicating 
your personal involvement in the materials; do not 
call them "my*' products. $ay that they were put 
together by a group of people (which Is usually true) 
and that you are helping to locate problem areas 
and weak spots. The trainee should also be told 
that your role is not to teach him but to watch him 
try to learn frpm the material. Resist the temptation 
to rush to his aid every time he hesitates or makes 
an error* Instead, ask if he would mind thinking 
aloud to help you understand what is bothering or 
confusing him. Requests for assistance indicate that 
the material should be modified. The trainee should 
then work through the revised version. 

Programed instructional materials permit tracking 
the tfalrtee*s learning through the responses made in 
each frame. If the format of the material does not 
require the trainee to make such periodic responses, 
identify all logical units of instruction and prepare 
a probing question at the end of each. At least, re- 
quire the trainee to summarize everything learned 
in the unit. Also monitor spontaneous comments 
(e.g., "That's a drag!") and nonverbal reactions (e.g., 
counting the number of pages still to be read) that 
indicate motivational weaknesses in the material. 
Tryout sessions should be concluded before the 
teacher trainee becomes tired. After each testing 
session, interview the trainee for additional infor- 
mation and suggestions. If the trainee did not re- 
spond frequently during instruction, an informal 
oral posttest may be given. 

On-the-spot changes should be incorporated in 

O 
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the material and additional modiflcations should be 
undertaken immediately after each developmental 
testing session. It is not the number of tryouts but 
the quality of revisions that improves the material. 
The trainee should, of course, be tested with the 
revised version. When the material begins producing 
consistent results in the tesl-revise-retest cycle, a 
second (quantitative) stage of developmental testing 
is called for. 



Quantitative davelopmantat tasting 



The purposie of this stage is to further refine the 
material on the basis of quantitative feedback. Before 
undertaking the actual tryout, produce duplicate 
copies of the revised version of the material and 
copies of criterion-referenced tests (see Chapter 7), 
In addition, prepare instruments to measure the 
trainee's uttitude toivard the content and the format 
of instruction. A number Of Informal techniques for 
questionnaire construction are described by Mager 
(1962). Among the more formal techniques, Likert 
(1932) scales and semantic differentials (Osgood, 
Suci, & Tannenbaum, 1957) are useful. Figure 18.1 
shows a sample semantic differential to measure 
the trainee's attitude toward the content, and Figure 
18.2 shows a Likert scale that measures the trainee's 
attitude toward the format (vi2.» instructional games). 
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Given below are some pairs of adjectives which may be 
applied to Informal reading testa. Between each pair 
there are five blanKs. Place an "X" In the blank which Is 
closest to the way you feel about Informal reading tests. 



unpleasant 

useful 

dull 

powerful 
effective 
ctear 
relevant 

practical 

personally 
hetpful 

appropriate 



pleasant 

useless 

stimulating 

weak 

inolfective 

unclear 

irrelevant 

idealistic 

not personally 
helpful 

inappropriate 



beneficial not beneficial 



novel 

important 

Interesting 

efficient 

costly 

valuable 



traditional 

unimportant 

boring 

inefficient 

Inexpensive 

valueless 



Figure 18.1. 

Semantic differential on informal reading tests. 




Read the following statemsf^ts about Instfucttonal Oimes. 
Indicate the extent of your agreemer^t or disagreement 
with the statement using the following key: 

A^-strongty agree 
B— agree 
0--undec(ded 
D--<ijsagree 
£--strongly disagree 

1 . Playir>g the game has been a total waste of time. 

2. Qa^nes are for kindergarten. 

. 3. Games are fun. 

4. Lectures Should be replaced by games like this. 

. It Is tmpossible to learn anything worthwhile 

from games. 

6. I'd rather read a textbook than play silly games. 

7. Games are not for me. 

— 8. Games are more realistic than other Classroom 
activities. 

9. You learn a lot of useful things when you ptay a 

game. 

10. Tm glad my other classes don*t use games. 

1 1. Games make learning Interesting. 

12. If I were a teacher, Td use a lot of Instructional 

games. 

1 3. I prefer any other method of learning to playing 

games. 

1 4. I would not mind if I never play another one of 

those games agala 

16. Games sure beat listening to lectures. 

16. I could have played the games forever. 

ir. Games fake the seriousness out of education. 

18. Games help us learn from each Other. 

19. Anything that Is learned through games is 

easily forgotten. 

20. Ga.'nes never teach. 

Figure 18.2. 

A Likert scale on attitude toward instructional games. 



Finally, an instructor's manual specifying details 
of use should also be developed for the material at 
this stage, ' 

Begin the second-stage tryoul by administering 
entry and pretests to trainees. Next, distribute copies 
of the instructional material with instructions to 
trainees to work independently* Follow the direc- 
tions in the instructor's guide but if the procedure 
must be changed for any reason, incorporate the 
change In the manual. Administer the postt '^t as 
soon as each trainee completes the material, 

After the tryout, tabulate the data from the post- 
test and locate those sections of the instructional 
materiat that need strengthening* Table 18. t may 
be used to analyze the pattern of errors. 

If the same error is made by a majority of trainees 
(e.g., hem 8 In the table), try the following modi- 
fications: 

□ Check the test item for anibiguily. Rewrite it 
if necessary. 

□ Check individual responses for consistent mis- 
conceptions. Revise the appropriate section of the 
material. 

□ Check the entry-test performance of teacher 
trainees who made the error. If you have made ^ny 
false assumptions about their entry levels, begin 
instruction at a more elementary level 

If an item is misled by a number of learners but 
not the majority (e.g., Item 4 in the table), try these 
modifications; 

□ Check individual responses for consistent 
misconceptions. If there are any» prepare a remedial 
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section for use by the trainees missing the item. 

□ Check the entry-test performance of the 
trainees who made the errors. If they lack any es- 
sential prerequisite, prepare supplementary ma« 
terlal for their use, 



Name of trainee 



Postte$t item 
1 2 3 4 6 6 7 8 9 10 



1. 






















2. 
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9. 






















10. 






















11. 






















12. 























Table 18.1 

Analysis of responses to posttest questions. Minus sign 
( - ) Indicates an error. 
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If an Item is missed by very few trainees (e.g., 
Item 7 in the table), no special revision Is necessary. 
Even with the most effective materials, random 
errors can be expected. 

You may find suggestions for other revisions in 
the trainees* comments. Data from attitude question- 
naires can also be tabulated to locate consistent 
complaints. If one trainee claims that the protocol 
film looks artificial, the comment may be disre- 
garded; but if all trainees report the same feeling, 
drastic revision is suggested. 



Totat^package tasting 



After making modifications on the basis of quanti- 
tative tr>out$, test for comprehensiveness and pre- 
cision of the material. The instructor's manual is 
also reviewed at this stage. 

Total-package testing requires the cooperation of 
other trainers who teach a course in which your 
material could be used. Ideally, a trainer from an 
institution other than your own shouid be chmen. 
Send him a sufficient number of copies of the ma- 
terial along with the instructor's manual. Encourage 
independent decision-making when minor problems 
arise in the field. At the end of this field testing (or 
periodically during it), ask the trainer to collect and 
send the comments and responses made by trainees. 
In addition, ask him for his opinions and sugges- 
tions, either informally or by responding to a ques- 
tionnaire, such as the following one: 



Sample trainer questionnaire for total-package testing. 
This questionnaire was used during the field testing of 
the Instructional game ANTICIPATION (Semmel, 1971). 

Anticipation gama data 

1. Title of the course or workshop: 

2. information about teacher trainees: 

a number of trainees: 

b. level of trainees: 

c. special characterlfitfcs: 

d. names of trainees who did not participate In all 
sessions: 

3. Time data: 

a. class meetings 

1. frequency; 

2. duration: 

number of sessions: 
4. total time: 

b. preparation 

1. Instructor's tinie spent In planning the game 
sessions: 

4. Instructor's role: (Brief/y descrltse the role you prayed 
In btroducing, conducting and debriefing the games.) 

6. Qameeqiilpment 

a. Did you have all necessary equipment? ( ) yes 

( ) no 

If no, what Items did you lack? 
How did you handle their absence? 

b. What problems did you have with the use of the 
equipment? 

c. tn what ways could the equipment be Improved? 
6. RMiebook: 

a. Did you find the rules clear? ( )ye$ 

( )no 

b. Old any Issues arise during the play of the game 
which were not covered in the rule book? ( ) yes 

( )no 

If yes. please specify the problem* 
How did you handle It? 

0. Suggestions for improvement of the rulet>ook: 
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7. ActlvitiH: 

a What games and activities did you omit from those 
suggested In the instructor's manual? 

b. What games and activities do you betleve coufd be 
omitted without detracting from the attainment of 
the objectives? 

0. List and describe any add Itional games or 
adtivities you used: 




Chapter 19 

Summatlve evaluation 



Objectiv^a 

1 . Differentiate between formative and summatlve 
evaluation and describe different types of sum- 
matlve evaluation. 

2. Describe the procedure for summatlve evalua- 
tion of an Instructional material 

3. Select an appropriate design for the evaluation 
of a given Instructional material. 

4. Construct or collect various tests and measuring 
Instruments for the summatlve evaluation of an 
instructional material. 

5. Analyse data from summatlve evaluation and 
report It in a suitable format. 



Production of the final version of an instructional 
material Is indicated when the formative evaluation 
yields consistent and positive results. However, 
prior to the packaging and dissemination of the ma- 
terials a summatlve evaluation is required. 

The purpose of the summatlve evaluation differs 
from that of the formative evaluation in that its goal 
is to describe the effects of the Instructional material 
rather than to improve its effectiveness. In summa- 
live evaluation, a representative group of target 
trainees works through the material under specified 
conditions. Data are collected on the characteristics 
of the trainees; the changes in their skills, knowledge, 
and attitudes; the cOrttext in which the material i$ 
used; and the time requirements. In addition, $um- 
mative evatuatton also Involves professional Jurying, 
that is, a panel of experts critically appraising the 
material and providing opinions oh its content, 
strategies, and production quMUy. 



Three pham of validation testing 



Internal validation* This phase Identifies the ex- 
tent to which the Instructional material effectively 
teaches what it is supposed to teach. It tests the 
trainee by criterion-referenced test immediately 
after instruction to check the attainment of the in^ 
structional objectives. For example, if the objectives 
of an instructional material are for the trainee to 
administer an informal reading test to EMR chil- 
dren and to interpret the results accurately, the 
trainee may be tested on his ability to list the various 
steps involved, formulas to be used, and precautions 
to be observed. The trainee's ability to identify and 
classify different types of disruptive behaviors, 
choose the most appropriate control technique, and 



describe the procedure for applying the technique 
may be used to test Instructional materials on class- 
room control. 

Internal validation is usually undertaken during 
or immediately after teacher trainees complete the 
Instructional material. The most important measur- 
ing instrument in this phase is the criterion ^cst 
which is based on the objectives of the Instructional 
material. The test is usually constructed by the 
developer. 

Transfer valklatlont Even when internal valida- 
tion indicates that the trainee has mastered a certain 
skill or knowledge, there is no guarantee that it will 
be applied In everyday teaching behavior. Transfer 
validation measures the extent to which a teacher*s 
real-world performance is affected by the skill or 
knowledge he has acquired from the instructional 
materia). This phase of validation usually occurs 
during the trainee's practice-teaching sessions or in 
actual classroom teaching. Self^reports from trainees 
as part of their regular record-keeping responsi- 
bilities, and observation coding systems used by 
supervising teachers or peers, enable the collection of 
valid data unobtrusively. For example, the teacher's 
records may be Inspected to check the extent of the 
actual administration of informal reading tests in 
the classroom and the use of the results to prescribe 
suitable reading materials. The supervising teacher 
can use a checklist to count the number of times and 
note the skill with which a teacher uses certain con- 
trol techniques to stop disruptive behavior in the 
classroom. 

Payoff validation. The ultimate criterion for ef- 
fective teacher training is facilitation of exceptional 
chitdren*s learning. Changes in teacher performance 
are not ends In themselves bus the means of increas- 
ing learner achievement. Obviously, the developer 
of any instructional material is conHdent that the 



skill or knowledge he has presented will Improve 
children's performances. Such confidence Is wr.r- 
ranted when the materials are based on sound theory 
and/or research* Payoff validation provides an op- 
portunity to substantiate this assumption, As Okey 
and Ciesia (1972) pointed 6uU the emphasis In this 
phas^ is not on the acquisition of a skill, but on the 
effects of using it. The most important aspect Is 
testing children and measuring the extent to which 
their achievement results from the trainee's newly 
acquired skills^ For example, the payoff validation 
of the skill of administering Informal reading tests 
is the assessment of whether a reduction has oc-^ 
currcd In the number of reading errors children 
make. Similarly, ascertaining whether a measurable 
decrease of disruptive behavior in the classroom 
has occurred validates the effect of the trainee's 
acquisition of new control skills and techniques. 

Guidelines for validation testing 

Figure 19.1 outlines the different steps in the 
validation testing of an instructional material. Ini- 
tially, a number of sets of the material must be pro- 
duced with a specific strategy for using the material. 
Before actual evaluation can take place, a suitable 
design is selected, appropriate tests are constructed 
and collected, and arrangements are made for sub- 
jects to work through the materials. The actual 
evaluation involves the testing of trainees to identify 
their entry level, requiring them to work through the 
material under specified conditions, and testing them 
again to measure changes in their skill, knowledge, 
or attitudes. Finally, data from the valiation study 
are analyzed, interpreted, and reported, 
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Mil«rlali 



PrtHmlnary 



Evalvatlon 




Data analyiia 
and raport: 



Figure 10.1. 

Steps (n validation testing of Instructional materials. 



Assembling instnictlonal material 
and speciiying mode of use 

Occasionally! the developer may forget the pri- 
mary goal of summative evaluation and revise the 
material while he i$ conducting the test. In this 
situation, the evaluation loses replicabiliiy and re- 
verts to the formativ0 stage. Revisions in the ma- 
terial and the strategy for use do not guarantee Im- 
proved effectiveness until another round of testing 
with the revised package Warrants such a conclusion. 
For maximum replicabiliiy of results, it 1$ essential 
to assemble enough sets of the malerial in its final 
format and to stipulate specific guidelines on how 
to use them. The procedure recommended in the 
instructor's manual should be rigidly followed In 
validation testing. 

it is important that some form of process evatu* 
ation take place during the summative test in order 
to determine, just as in formative evaluation, whether 
the treatment was implemented as intended. The 
difference in process evaluation at the formative 
and summative stages is that in the former it is used 
for either revising the treatment or the strategy by 
which it is implemented and in the latter it is used 
to validate the summative test. Unless you can docu* 
ment that the material was reasonably well imple- 
mented at the time of the summative test, the results 
will always be open to rival hypotheses, especiaily 
with a *'no significant difference*' or unexpected 
**control is better than experimental" outcome. 

Many educational treatments fail their summative 
evaluations because they were not implemented as 
the developer had intended. The importance of 
validating the processes during the delivery of the 
treatment cannot be overstated. Unless one can 
document that the materials tested were implemented 
as intended during the summative evaluation, the 
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results will frequently be uninterpretable. 

There are many ways by which materials can be 
varied in their presentation, thus altering signifi- 
cantly the intended process and, possibly, the desired 
outcome. Three of the more common sources of 
departure from standardized delivery of an instruc- 
tional materia) are, 

Timing: The material was designed for use 
within a 45-minute period but actu- 
ally took 120 minutes to complete, 
Sequencing: Components of the material were 
designed for presentation in a spe- 
cific sequential order (A, B, C) but 
were, in fact, presented in a different 
order (e,g., B> C, A). 
Completion: The material was designed to be 

used in its entirety but some trainees 
sicipped sections. 
Process measures are invaluable to the under- 
standing of a summative evaluation. We would do 
well to remember that an educational treatment 
consists of both the instructional material developed 
and the actual operations of the delivery system 
during the summative evaluation. It is not enough to 
describe the intended process— we must directly 
observe the implementation of instructional materials. 



Selection ol eva)uatlon design 



Instructional format, length of time, extent of 
trainer participation, and availability of subjects for 
testing— all impose restrictions on the choice of 
evaluation design. Six designs for internal validation 
of instructional materials and two for payoff valida- 
tion are outlined below. All designs are based on 
Campbell and Stanley*s "Experimental and quasi- 
experimental designs for research on teaching" (1963). 



One group pretest-positest design 



S of 



This schema outlines a simple before-and-arter 
design. A group of teacher trainees are pr^ested on 
the instructional objectives before they woi k through 
the instructional material; immediately afterwards 
they are given aposttest. Imprcvemeni in test per- 
formances may reflect the effectiveness of the in- 
structional material. 

This particular design suffers from so many in- 
validating factors that Campbell and Stanley (1 963) 
classified it as pre-experimenta) and used it as a 
"bad example" to illustrate confounding variables. 
However, in many training situations, where it is 
impossible or undesirable to deny instruction to a 
sub-group of trainees, this design may be the only 
usable one. It is especially useful for the summative 
evaluation of short modules. The brief duration of 
instruction prevents confounding through histoiy 
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(i<e,^ outside occurrences influencing learning) and 
maturation (I.e., trainees growing up into belter 
performers). Another confounding variable in this 
design Is that taking the pretest affects the trainee's 
level of motivation and sensitizes him to pay special 
attention to certain facts and concepts. However^ 
since many modules incorporate the pretest as ah 
instructional component, what is measured is the 
effect of the pretest and the material as a total 
package. 

Figure 19.2 is based on data from a validation 
study using the one group pretest-posttest design. 
As a pretest, teacher trainees were administered a 
criterion-referenced test on grouping EMR children 
for instruction. After completing ah alidiotutorial 
module on the topic, they were given an equivalent 
form of the criterion test as^ poisttest. Notice the 
norma) distribution of fairly low scores oh the pre- 
test and the positively-skewed distribution of high 
scores on the posttest, indicating the effectiveness 
of the module for the trainees in the study. 



Pretest 
Posttest 




Test scores 



Figure 19.2. 

Data from a one-group pretest-posUest study. 



Control-group design t. 

Isolating effects of Instructional material 

4^' 




With more complex instructional materials which 
require longer periods of time, it is not at all feasible 
to isolate and control the experiences of trainees. 
In such cases, a control group is required in order 
to establish the effects of such confounding variables 
as history, maturation, and testing. In the pretest- 
posttest control group design, trainees enrolled in 
a course are randomly assigned to two groups. Both 
groups are administered the pretest and, after a 
suitable lapse of time, the posttest. In between, only 
the experimental group works through the instruc- 
tional material. Any confounding factor that aug- 



ments the posttest performance of the trainees 
should operate equally on the control group. After 
taking this factor into account, whatever differences 
are obtained in the performance of the experimcntaJ 
group may be inferred to be the effects of the in- 
structional material rather than of history, matura* 
tion, or testing. The data say nothing, however, of 
the superiority of the material compared to other 
instructional programs. 

Figure 19.3 is based on data from a control-group 
validation test of a 20-hour instructional package 
on behavior management techniques. Although the 
control group shows som^ gain in performance, the 
gain of the experimeiital group is noticeably larger. 



O—O Experimental group 
O O Control group 



4- 



Pretest Posttest 



Figure 19.3. 

Data from a pretest-posttest control group study. 



Control-group design 2* 

Comparison of two different instructional modes 




4V 




The nature of teacher-training courses is such that 
it is very difficult to withhold instruction from a 
sub-group of trainees to form a control group, as 
required in the previous designs. To circumvent this 
difficulty, the experimental group is put through the 
instructional material while the control group re- 
ceives instruction through a ''conventionar* format. 
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Control-groiip deilgit 3« 
Using intact cliiiei 



Within diii poitteit only 




\ 





This de«ign offers m alternative solution to the 
problem of withholding instruction from a control 
group. In large teacher-training programs, more 
than one section of trainees often are available. Two 
intact classes of trainees can be used as experimental 
and control groups; Instruction is not denied to the 
control class; it is merely postponed to a later se- 
mester. The only difYerence between this non- 
equivalent control group design and design two is 
that the trainees are not randomly assigned to groups. 
Any natural biases In the enrollment In the different 
classes will confound the effect of the Instructional 
material. An evening class, for example, is more apt 
to contain Inservlce teachers than a class that meets 
during the day. 



Another problem with the evaluMlon d<r igns 
prc/^ented thus far concerns the administration of the 
pretests, particularly lengthy tests, and their effect 
on the control group. Campbell and Stanley (t$63) 
pointed out that if tratne<:^ aie randomly assigned 
to groups, there Is no need to administer a pretest, 
In the posttest-onty control group design diagrammed 
abovci two random groups are created^ one learning 
from the instructional material and th^ other re^ 
ceiving no Instruction. Both groups are posttested 
after the experimental group completes the material 



Figure 19.4 is based on data from a validation 
test using the posttest only design. Notice the simi- 
larity between this figure and Fij. i? 19.2 which 
shows results of a one-group, ytetf (-posttest study. 



— Control group 

— £xp«fimenial (jroup 




Test scores 



Figure 19.4. 

Data from a postlest-ortly control group study. 



Validating managerial formats 
Equlva(ent*ma(ertals samples design 



.6* 
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This design is especially useful for establishing 
the effects of management formats. No control 
groups are needed since each learner serves as his 
own control. At the beginning of the study, a number 
of equivalent units of instructional materials are 
assembled. The units are used alternatively with two 
different strategics. For example, the odd units may 
be accompanied by behavioral objectives, and the 
even ones may be used without them. Or, every other 
unit may permit repeated testing while the others 
allow only a single test, 

Figure 19.5 is based upon data from eight equiv- 
alent directives. Four contained sets of specific 
behavioral objectives, the other four did not. Note 
the obviously more effective results from the re- 
peated-testing format. It should also be noted, how- 
ever, that the equivalent-materials design diminishes 
in usefulness as the numt^r of equivalent materials 
are increased. Because the design functions without 
a control group and the same sample receives re- 
peated applications of equivalent materials, learning 



to learn, learning set, and accumulative learning 
may work to diminish between-material-variance 
toward the end of a lengthy cycle. Thus, the eight 
equivalent treatments measured in Figure 19. S may 
not have been a wise application of the design. 



□ - Without oblectives 
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Successive handouts 



Figure 10.5. 

Data from an equlvalent-materiald sample study. 



ERIC 



155 



Payoff villdatlon li 
Time Uriel 
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Payoff validation Involves the mcasuremeni of 
the ultimate impact of the instructional material on 
exceptional children rather than the Immediate 
changes in the teachf^r^ behavior. In the illustrated 
(Ime series design a class of exceptional children 
instructed by a particular teacher or trainee is t^v 
ministered a series of periodic tests (e g., weekly 
arithmetic tests). These tests begin long before the 
teacher trainee encounters the instructional n^aterial 
and continues after the material Is compteted. The 
effect of the newly acquired skill and knowledge is 
assumed to be reflected In the children's perform^ 
ances In the later series of tests. 

Figure 19.6 is based on the data from seven EMR 
children taught by the same teacher. The teacher 
worked through an instructional package on pre- 
scriptive teaching of arithmetic after the first three 
tests. Notice the general reduction In the number of 
errors made by the children in subsequent tests, 
which Is some evidence that the Instructional pack^ 
age had an impact on children's performances. 



J^Teacher works through 
; the in$truct)onal 
I material here 




2 3 4 
Successive tests 



figure lO.e. 

Data from a time*ser(et itudy« 
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P«yorrvalldatioQ 2. 
EqulvAl'iit time Mmplet design 



/// 

w 



This "on-aml^off * design Is similar to ihe equiva- 
lent-materials samples design discussed earlier* The 
design is useful! for checking (he payoff validation 
of an instructional package after the teacher trainee 
has acquired some new teaching technique. The 
trainee is instructed to teach for equivalent periods 
of time (e.g.* a week) alternatively using and not 
using the new teaching technique. The trainee also 
administers a posttest at the end of each time period 



on the topics covered during that period. 

Figure 19.7, based on data from Okcy and Clesla 
(1972), indicates how the use of skills from a 
module called Teaching for Mastery makes a dif- 
ference In the performance of 29 students In a sixth- 
grade classroom. 
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1 2 3 4 

8ucceMfv0 perlodi ol t««chlno 

Kiguf 019.7. 

Data from an equlvafent tim^ tiamplee study. 

Single ittbjKldetlgnb/ 

A number nf nsftful single subject designs also 
have been developed primarily for the study of be* 
havlor modincatlon. Th^y have not, as yet, been 
widely applied to the evaluation of instructional 
materials. However, there appears to be great po- 
tential in the utilisation of single subject design \n 
th^ evaluation of instructional programs. A useful 
review of the major single subject designs can be 
found in Wolf and Risley's chapter, ''Reinforcement: 
Applied research^UI971). ' 

Additional sources of evaluation information are 
listed in the selected bibliography at the end of this 
chapter and, also« In the bibliography on lests and 
test construction at the end of Chapter 7. 
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Contlructing and cotl^cllng toils 



The types of tests used for validation may be 
classified a:^ input, proces.s and output measures. 

Input measures check the entry behaviors and 
characteristics of teacher trainees before they receive 
instruction. These measures help to answer such 
questions as, ^'How many of the skills did the trainees 
already possess?** *'In what ways do these trainees 
differ from the target population for the material?" 
and *'How do trainee preferences inierapt with the 
rate at which ihey learn from the material?** 

Process measures keep track of the events during 
the period that the teacher trainee works through 
the Instructional material. They help to answer such 
questions as, *' How long is the trainee able to work 
at the materia] without fatigue?*' and ''What major 
problems are faced by the trainee In using the 
materlair' 

Output measures test the trainee*s achievement 
ofter instruction. They help to answer questions 
about changes in his behavior* knowledge, and 
attitude. 

Here is a brief description of specific tests from 
each category 

Input measures 

Aptitude tests* These tests, usually standardized, 
measure teacher trainees* aptitudes that relate to 
the skill to be learned. An aptitude test on listening 
comprehension, for example, may be administered 
to the trainee before he goes through a training 
module on appropriate reactions to children*s ques* 
tions, if the developer believes that the skill Is re* 
lated to the aptitude. The use of aptitude tests per* 
mits identification of the characteristics of those 



trainees who benefit most from the instructional 
material. 

Entry questionnaire* Information on varibus edu- 
cational and experiential aspects is collected from 
the trainees through a questionnaire. Prevlo^is teach* 
Ing experience, Including number of years and type 
of children taught^ is an example of relevani data 
collection. ' ; 

Entry test. This criterion-referenced test'mea* 
sures the prerequisite skills and knowledge neces- 
sary for the effective use of the Instructional material. 
In Chapter 7, the details were discussed of (^n* 
structlng such a test from the statement of entry 
behaviors* An Ideal entry test helps the trainer to 
diagnose exact deficiencies and prescribe suitable 
remedial instruction. 

Pretest Also a criterion-referenced test <jon- 
structed by the developer, the pretest Is designed to 
measure the extent to which the teacher trainee has 
already attained the objectives of the instructional 
material. 

Process Measures 

SeIf«report8 and observation systems. Frame-by- 
frame responses of a student progressing through a 
programed instructional unit is an example of 
process data. The trainee*s learning behavior may 
also be observed uMth a suitable coding system. In 
an instructional game, for exaniple» the degree of 
each tralnee*s Involvement can be Observed and re- 
corded. In addition, trainees can be asked periodi- 
cally to check relevant items on a self*report check- 
list which describes theit feelings and reactions to 
the material 



158 



Output Measures 

Postteitf A pcrallel form of the pretesti the post- 
test is taken by the ?ralnee upon completing the in- 
structional material. U )s constructed by the de- 
veloper and It is b^sed orj the objectives of the in- 
structional material. Comparison of pretest and the 
posttest performances assists in measuring the gains 
in the trainee^s achievement. 

Trfinifer (est and observaHon systems. This per- 
formance test most often requires the trainee to 
teach in a real classroom. A suitable checklist or 
observation system may be used unobtrusively to 
measure the extent to which the trainee applies his 
skills and knowledge to the classroom situation. 

AttttiKlinai measures. In addition to teaching the 
trainee new skills and knowledge, the instructional 
material may be instrumental In changing his attl* 
tude. The construction of scales and questionnaires 
by which the developer can measure these changes 
was discussed in the chapter on formative evalua^ 
tlon. The snme type of instruments may also be used 
for summ. live purposes. 

Conducting the validation test 

The choice of a teacher trainee population for 
summative evaluation depends upon both needs 
and availability. The particular evaluation design 
also dictates how the subjects should be selected 
and assigned to various groups. Federally funded 
projects are required to adhere to government regu- 
lations on the use of human subjects. The publica- 
tion, The Institutional guide to DHEW policy on 
protection of human subjects (1971), outlines these 
regulations. 

In the selection ot subjects, relevant information 
on them, such as 10, achievement, and grade point 



average, can often be obtained from the records of 
public institutions. If pretesting is essential to the 
design, sufficient time should be allowed to schedule 
the test after the subject selection and before the 
teacher trainees go through the instructional ma- 
terial« During instruction, the necessary steps should 
be taken to Insure adherence to the use strategy 
stipulated in the teacher's manual. After Instruction, 
posttesting can be immediate or it can be delayed 
for a period of time, depending upon the validation 
phase, In either event, posuestlng Is usually more 
complex than pretesting. 

Analysing data 

It is strongly recommended that the instructional 
developer consult with a measurement and data 
analysis expert as early as possible in the planning 
phases of a validation study^ Early consultation can 
frequently avoid costly delays and post hoc data 
analysis. Data analysts are usually more helpful and 
cooperative when given an opportunity to assist In 
the plan for treating the data prior to the collection 
of the data. 

After validation testing, the various instruments 
are scored, coded, transferred to computer cards, 
and analyzed according to a pre-designed procedure. 
If quality control measures have been carefully at* 
tended to throughout the formative evaluation stages, 
the data will be unlikely to indicate that the instruc- 
tional material Is totally unreliable or ineffective. 
However, some unanticipated weaknesses, which 
indicate that the material is not yet ready for large- 
scale dissemination may be discovered. In this case, 
results from the valiatlon testing should be analyzed 
to provide additional formative feedback, and suit- 
able modification should be made. Unless these re- 
visions are minor, summative evaluation should be 



repealed with the modifled material to ensure that 
the effectiveness has been improved. When valida* 
tion testing yields positive results, an evaluation 
report can be written and the fina! packaging and 
<!!!^tlbution of the material can begin. 

ProfeMlOttilJiitybig 

techniques for collecting expert opinions on the 
appropriateness and technical quality of instruc- 
tional materials were discussed in Chapter 17. The 
same procedure may be used again for professional 
Jurying of the total package. Expert opinion in this 
case Is not used to modify the material but to pro- 
vide the consumer with objective appraisals. Both 
positive and n^ative opinions should be reported 
as a part of the final validation report. 
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Chapter 120 
Pirt«l packaglnQ 



1. Prepare the instructional material for final oack* 
aging by obtaining necessary permission and 
releases. 

2. Consider authorship rights and how to obtain a 
copyright. 

3. Provide rationale for high production standards 
(n final packaging. 



Throughout the earlier stages, the need for consld* 
ering various dissemination Issues has been stressed. 
Whh the completion of summatlve evaluation, the 
dissemination issue comes to the fore. Modesty and 
reluctance may prevent the developer from push- 
ing his materials, but, If they hgve been systematic 
cajly developed and emplrkftUy validated, it Is the 
developer's responsibility to give them the widest 
possible dissemination, tn many instances, teacher 
trainers develop materials and programs to meet 
local needs and conditions and make no effort to 
disseminate them. They cannot or will not consider 
the issues involved In getting the materials to other 
programs In which they could be used. Through the 
widespread communication of training program 
developments, field-wide progress toward a more 
sophisticated corps of well-prepared special educa* 
tion teachers may be realized and the wasteful dupli- 
cation of effort prevented, The major professional 
organizations in the field of special education, in 
recent years have begun to recognize their reciprocal 
responsibility toward the individual and group pro- 
gram innovator by sponsoring and encouraging dis- 
semination activltltes. Some of these developments 
are discussed in Chapter 21 . 
The skills required of e disseminator are quite dif- 
ferent from those of a developer; consequently, 
packaging and distributing responsibilities may have 
to be turned over to another person or team. This 
chapter discusses some practical packaging con* 
sideratlons that apply to small-scateHdeveloper pro- 
duced packages as well as to commercially produced 
materials. 

Sdectiitg the prodiicer and the dUiemlnator 

The producer who undertakes the production of 
multiple copies of the final version of an Instruc- 



Dear Sir (Gentl«Mn)s 

t (w«) would lik« to have your permission to 
us« tho foltowinf copyrighted material in my (our) 
book (Instructional module, film) entitled (title 
of the Initnacticnal material) to be published 
(distributed) by (name of the publisher or dits^i'* 
tnator) arp\«id (approximate dete of publicetipn). 

Direct <^Motation of approximately words 

beginnini with the words " ** on page n 

lin« end ending with the words 
on page line 

Conden$atlcn(s) (paraphrase (s)) of material 
appearing on page 

Illustrations (Figure ) ftcm page ,..«. 

We will be using the following credit line to 
acknowledge your material as the original source} 

(Cive book reference according to the AI^A 
*tyle) 

I (we) will deeply appreciate your signing 
the permission foim in the duplicate copy of this 
letter and returning it at your earliest ccnve* 
nience. You may keep this copy of the letter for 
yoi)r files. 

Yours sincerely, 



I (we) grant permission to reproduce the material 
specified above. 

Date ly 



tlonal material may be a printer, rilm-maker» or 
packager. The disseminator markeU or distributes 
the material. The same person may serve both func* 
tions, as in the case of publishing. Very few teacher- 
training programs in special education are equipped 
to undertake either activity. Many commercial or- 
ganisations may be eager to undertake the final pro- 
duction for a fee but very few, if any, are enthusi- 
astic about marketing the materials because the 
market for special education teacher-training ma- 
terials is very thin. It has been variously estimated 
that the maximum sale Is around 2,0<X) copies di- 
rectly to trainees or 200 to teacher-training pro- 
grams, over a period of five years. The reluctance 
of commercial sources to disseminate special educa- 
tion materials suggests the need for a combination 
of commercial production and local distribution* 



Obtaining releam 



Before final production, the developer must ob- 
tain certain clearances. For example, permission is 
needed to quote from other copyrighted materials. 
No special permission Is required for quoting from 
materials in the public domain (e.g., legal docu* 
ments and books published more than 56 years ago). 
Usually, permission is not needed to quote pas- 
sages of less than ISO words from textbooks. How- 
ever, it is a courteous gesture to request permission 
to quote even short passages. With trade books, ask 
permission before quoting anything. Even if not 
quoting directly but merely paraphrasing or adapt- 
ing another author's ideas, permission should be 
obtained. All permissions must be secured from the 
holder of the copyright, who may or may not be the 
author. A model letter for asking permission is given 
in Figure 20.1. 



Pigura 20.1. Model fetter requeeting parmtesion to use 
copyf Ighted material. 
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Another type of clearance is required before final 
producilon for photographs, video tapes, and films 
of all living persons. Such a release is required even 
from friends and students as long as they are recog- 
nizable, In the case of minor children, the release 
must be obtained from the parents. You should re- 
assure parents of handicapped children that the 
material will not be used In any derogatory manner, 
A model release form is shown In Figure 20.2. 



» hffaby glv* ptrmtssJon to (y^ur ntmt or namt 
ol iht loititutlon prof^g^tn^ tha Instructional matarlal) 
to m^pktur^ Wm cllpa. vl<fao /deordlnoa) ol mi 
(my mioof child (nama of child) ). and uta tha 
linlihad product for any lagitlmate purpoia wHh- 
Oiil limitation. 

Oatt: 



Signatura. 
Nama-^ 



Addraaa. 



Kiflure 20.2. Modol ralaaae form. 



Copyright contldtratlonf 



With the extremely thin market for teacher-training 
materials in special education, it is unlikely that a 
developer will grow rich on royalties Copyright is 
important, however^ to prevent instruciional material 
from being illegally exploited. There follows a brief 
Introduction to the copyright procedure. 

The owner of a copyright is granted exclusive 
rights to sell, distribute, translate, or transfer into 
other media the material which he has developed 
Copyright Is granted only to published materials, 
that is, to those made available to the publie. but 
all unpublished materials automatically come under 
the protection of the common law literary property 
provisions. Contrary to common belief, only the 
author or his agent may rightfully copyright the 
material he has developed. In the case of writers 
and Instructional developers working on a project, 
the law clearly states that It is the employer, not the 
employee, who is regarded as the author. Nor- 
mally, copyright protection lasts for 28 years and is 
renewable for another period of the same duration. 

What mi^ be ci^yrlgbtcd? 

Depending upon the format and media, Instruc- 
tional material may fall Into different classes a^ de- 
fined by the Copyright Office, (See Title 17, United 
States Code.) Textbooks, objectives outlines, re- 
source lists; tests for criterion-based formau; rules, 
directions, and scripts for games, simulations, and 
roleplays; programed Instructional materials, in* 
formation-mapped books, and handouts; and printed 
illustrations and charts, all come under Class A. 
Training modules which are predominantly slides 
or filmstrips come under Class J, Scripted or mini- 



mum-structure protocols come under Class L, and 
edited excerpts fall under Class M. The types of 
instructional materials which cannot be copyrighted 
include reprints of public documents (e.g., special 
education legislation), and blank tables and forms 
(e.g., forms for use in resource-management formats) 
which are designed for recording rather than con- 
veying information. 

USOE copyright program 

Projects funded by the Office of Education must 
adhere to the USOE Copyri^t Program, They are 
outlined in the following two pamphlets: 

U.S. Office of Education copyright program in- 
formation. U»S. Department of Health, Edu- 
cation and Welfare, National Center for Edu- 
cational Communication (tJ.S. Government 
Printing Office, Superintendent of Documents 
Catalog No. HE5.2 1 1 : 1 1 03 NA, 1 97 1 ). 

Office of Education copyright guidelines. U.S. 
Department of Health, Education and Welfare, 
National Center for Educational Communica- 
tion (Government Printing Office 899-601). 
Reprinted from the Federal Register, 35 (91), 
May 9. 1970. 

Basically, this program provides the right to copy- 
right to the developer for a short period during de- 
velopmental and field-testing stages, and to the 
disseminator for a specific limited period (usually 
seven years). Beyond this period, all materials de- 
veloped through federal funding become public 
domain. 



How to obtain copyright 

The first step is to insert in the final version a 
copyright notice that includes the term copyright, 
the symbol ^, the name of the copyright owner, 
and the year of publication. In printed materials 
this notice should appear on the title page or its 
reverse side; in mediated materials it should ac- 
company or immediately follow the title. Immedi- 
ately after the final production of your instructional 
material, obtain the appropriate form from the 
Registrar of Copyrights, Library of Congress, 
Washington, D.C. 20540. Return the completed 
form with the fee and the number of copies speci- 
fied for the class of materials. 



Producticn standards 



When the decision Is made to disseminate the 
instructional material widely, production standards 
must automatically be raised, Oiiessman (1972) 
pointed out that "patently *home made' tapes and 
films will not do. The developers of the pilot , . » 
materials have in large measure rejected the naive 
assumption that users will overtook technical inade- 
quacy ... for the sake of having 'conceptually sound' 
materials. Fortunately or unfortunately^ the profes- 
sional consumer probably reacts to technical quality 
as quickly and surety as he may to conceptual qual* 
ity. The fact that the developer is producing ma- 
terials that are unique conceptually does not allow 
him to *beg' technical standards" (p.7). 

If a production is of fairly high technical quality, 
the final production may just require commercial 
duplication; if the products are shabby, however, 
the commercial producer may have to begin from 
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scratch, In any ev^nt, more work must still be done. 
In the publication of printed materials, for example, 
the manuscript must be typed, edited, and shipped 
to the publisher before the deadline; illustrations 
prepared; photographs reproduced; model releases 
and permission to quote obtained; type style, lay- 
out» and binding selected; galley and page proofs 
corrected; an Index prepared; and copyright ob* 
talned. In the final production of a film, one must 
specify length, color or black and white, synchron- 
ized or wild sound, and optical effects; produce or 
edit the script; suggest modiHcations on the rough 
cut and synch, effect, narration, and otusic tracks; 
inspect the answer print and approve optical effects, 
animations and titles, optical sound track quality, 
and suggest color corrections; and rccheck the final 
version of the film. 

Other desirable qualities for Instnictional materials 

In addition to high technical quality, a number of 
other characteristics are associated with widely dis- 
seminated instructional materials. Extrapolating 
from the findings of Rogers and Shoemaker (1971) 
in noneducational contexts and from the American 
Institute for Research (Crawford, Kratochvil, & 
Wright, 1972) in general educational contexts, four 
characteristics of instructional materials can be 
identified as essential for gaining wide acceptance 
in classrooms. 

L Face valMity. The instructional material should 
not only be relevant to the needs of teacher trainees 
and trainers but also appear to be so obviously. 
Face validity of the package can be increased by 
displaying Its goals, objectives, artd relevance in 
salient places. Expert opinion about the material 
and positive reviews in pn^fessional journals en- 
courage its acceptance. 

2. Completeness* Self-contained instructional 
packages are more widely accepted than isolated 



components. Total-package developmental testing 
will also help Identify missing components. Make 
sure that all elements are of equally high technical 
standards. Nothing is more disappointing than a 
dittoed sheet in the midst of a slick package. . 

3. Flexibility. A number of otherwise effective 
instructional packages are not used as widely as 
they deserve to be because they deal with a lengthy 
topic in a rigid fashion. Most successful packages 
permit local variations in their use and include a 
small component for a trial use before the entire 
package is adapted. If your instructional material 
contains a number of independent units, they should 
be made available on an individual basis. 

4. Ease of use. As far as possible the Instruc- 
tional material should be packaged to permit easy 
use. Thus, att unnecessary media requirements 
should be avoided. A comprehensive instructor's 
manual will go a long way toward simplifying the 
use of the material. As pointed out earlier, such a 
manual should not be added as an afterthought but 
should be designed as an integral part of the in- 
structional package and field tested along with other 
components. 

We have examined a relatively large number of 
instructional materials developed by special educa- 
tion teacher trahiers. Our experience leads us to 
caution the potential developer to exert particular 
attention to the need for making instructional pack- 
ages independent of their developers, that ts, they 
must be usable in the absence of the developer* 
Exportable packages must be usable without the 
necessity to communicate with the developer beyond 
the contents of the package. 



PuMkUIni th« AviUtf>Ully of lh« 
Instnictloiial M«l«ritl 

W« shatt not attempt h«r« to give you specific 
guidelines for writing advertisement copy. However, 
remember that the initial evaluation of a material is 
often made by reading a publisher's description or 
inspecting a sniall. sampler Icit. As Hull and Wells 
(1972) pointed out. the purpose of such descriptive 
literature on instructional materials is to clarify what 
it is, why (t was developed, how it worlcs, who can 
use it, when to use it, and what it is not. 



Chapter 21 
Diffuilon* 



Objoctlvei 

1» Ddscrlbe how the diffusion of new instructional 
products Is accomplished through dis$$mlna' 
tion, demonstration, and adoption facilitation. 

2. Incorporate the following in Ihe dissemination 
of a new instructional package: audience analy- 
sis, strategy for gaining acceptance of material, 
timing, and media. 

3. Plan demonstration activities to encourage ac- 
ceptance of new Inslruclional products. 

4. Draw up a strategy (or assisting the user in im- 
plementing a new instructional program, 



Several professional organizations concerned with 
special education are currently engaged In a variety 
of diffusion activities. Since developments in the 
field are so rapid, a summary of the status of these 
activities would be quickly outdated. However, it is 
important to note that among the organizations 
engaged in or actively promoting some level of 
diffusion activity, is the Council for Exceptional 
Children (CEC)» Che Teacher Education Division of 
CfcC, the Leadership Training InslilutejSpecjal 
Education at the University of Minnesota, the re- 
cently reorganized national network of Regional 
Resource Centers and Area Learning Resource 
Centers, and the National Center on Educational 
Media and Materials for the Handicapped. The 
Bureau of Education for the Handicapped, U,S, 
Office of Education, plays a central role In many of 
these efforts through federal sponsorship of pro- 
grams and active encouragement of diffusion of 
innovations to the field. Nevertheless, the diffusion 
stage of the instructional development process is 
most likely to be either unfamiliar to or neglected 
by special education teacher trainers and training 
program developers. This concluding chapter dis- 
cusses diffusion and materials utilization in order 
to acquaint the reader with the basic principles of 
diffusion and adoptJun and with some ol thc major 
issues raised by these activities* 



- Miiis Chapter was written for the Sourcebook by Or. 
Alice R. Jwaideh. Division of Instructional Systems Tech- 
nology» School of Education, Indiana University, Associate 
Professor. 1ST, and diffusion specialist for the Center 
for Innovation in Teaching the Handicapped. 
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WhatiiDlffutlon? 



Dirfgslon is the process through which a new idea 
or product becomes accepted and assimilated, that 
is, '•adopted," by an lndlvidual» a group, or a sys* 
tern. The three basic functions invoived In diffusion 
are (a) dissemination, (b) demonstration, and (c) 
facilitation of adoption. 

The diffusion process differs In many ways from 
the processes of development anc) production, Usu- 
ally It Increases In Intensity as the other processes 
near their culmination. After an Instructional pack* 
age has beeci designed* further activities are needed 
to gain its acceptance and adoption. The most ef* 
fecllve solutions to practical problems in teacher 
training can have rK> effect unless they are diffused 
to the level of the practitioner and adopted by him, 

The specific acliviiles to be performed In diffus- 
ing a new Instructional product or method differ 
considerably depending upon the Innovation, the 
characteristics of the potential users, and the sltup»* 
tion. Thus, In different situations, there may be rela- 
tively greater or lesser emphasis on aspects of dif- 
fusion Invok ing the roles of information conveyor, 
demonstrator, promoter, or consultant. In nearly all 
cases, however, the job of the diffuser is to link or 
bring together the improved products, materials, 
and practices— that is, the innovations— with the 
practitioners who might benefit from their use. He 
accomplishes this through the three basic functions: 
dissemination, demonstration, and facilitation of 
adoption. 

The dissemination aspect of diffusion involves 
spreading awareness among practitioners of the 
existence and general nature of an innovation. This 
task goes beyond merely imparting information; it 
involves the affective domain, for the disseminator 



must create a desire for the change, provide en* 
couragement, and. If possible, arouse genuine en* 
thusiasm on the part of potential users. 

Through demonstration, practitioners are given 
an opportunity to examine and assess the new prod* 
uct and build up conviction of its suitability and ef* 
fectlveness. The demonstration should provide a 
real chance for practitioners to gain experlet^e with 
the Innovation In a setting simitar to that In which 
they would use It. 

Facilitatton of adoption Involves helping the 
adopter to Incorporate the Innovation Into the func* 
tlorilng system ait>i providing htm with the necessary 
assistance and supi^rt to maintain It, Therefore, 
consideration must be given to such factors as pro- 
viding the necessary funds^ materials, and equip- 
ment required by the Innovation; adapting it to meet 
specific needs; training personnel to use it; and 
providing continuing evaluation of Its effectiveness. 



1. Oiiiwnlniition 



Audience aiiftlysli. Usually, the first step In ptun* 
ning a dissemination program is to decide upon the 
audience or audiences to whom the message will be 
directed. In disseminating Information about teacher 
training packages, the audience could be any one 
or more of the following groups: university special 
education programs, teacher education consortia, 
school administrators, teachers, teachers* organiza- 
tions, students, parents, community groups, state 
department of education personnel, curriculum 
committees, and specialists in various disciplines 
concerned with the education of the handicapped. 

After identifying the audiences to be reached, d 
careful analysis should be made of the characteHstics 
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of the members of each audieiKe, including their 
attitudes, vatues. and needs. The characteristics of 
potential users must be kept In mind in devising 
promotional or publicity material aimed at diffusing 
innovative products, 

Detetmlnatlon of stralegiei and themes, A diffu^ 
sion "strategy" Is an overall design for gaining ac- 
ceptance of an innovation. Cuba (1967) has de- 
veloped the following classification of strategies, 
bas^ upon assumptions about the audience; 

□ Value strategy, which views the potential 
adopter as a professionally oriented person who 
can be obligated to adopt through an appeal to 
his values. 

□ Rational strategy, which views the potential 
adopter as a rational entity wh > can be con- 
vinced, on the basis of hard data and logical 
arguments, of the innovation's utility (i.e.. Us 
feasibility, effectiveness, and efficiency). 

□ Didactic strategy, which views the potential 
adopter as willing to adopt but untrained to use 
the innovation; that Is, he has the appropriate 
values, motivations, and economic resources, 
but does not Icnow how to perform. 

□ Psychological strategy, which views she adopter 
as a psychological entity whose needs for ac- 
ceptances involvement, and inclusion can be 
employed to persuade him to adopt. 

□ Ecommk strategy, which views the adopter as 
an economically oriented entity who can be in- 
fluenced to adopt. 

O Authority strategy, which views the adopter as 
a member of a bureaucratic system who can be 
compelled to adopt by virtue of his relationship 
to an authority hierarchy. 



In planning dissemination activities, the dls^ 
seminator should attempt to select the appropriate 
strategy to persuade each of his audiences to con- 
sidert try^ or adq)t the innovation. He should make 
this selection not only on the basis of his assumptions 
about the audience's characteristics, but also on the 
basis of such considerations as his particular diffu- 
sion objectives, ihe nature of the Innovation Itself, 
the resources available for carrying out the diffusion 
effort and» of course, hts personal style. 

The deterhiinalion of specific themes to use will 
be based on similar considerations. Examples of 
some general types of themes that have been used 
frequently in disseminating educational innovations 
include the following: 

□ Child-centered, emphasizing ihat the change will 
benefit students. 

□ Fimncial emphasizing that the innovation wilt 
be economical In terms of benefits received. 

□ Trainer-centered, emphasizing that the innova- 
lion will conserve the trainer's time or energy. 

□ Community-centeredy emphasizing that ihe in- 
novation will benefit the community or society 
as a whole. 

□ Educational currency, emphasizing the desir- 
ability of keeping abreast of current educational 
practices. 

□ Leadership, emphasizing the training program 
or school district's reputation for leadership, or 
the prestige of being one of the first to Introduce 
the proposed change. 

Timing, in addition todecldifigupon strategy 
and themes, the disseminator must also plan the 
timing of the dissemination program. For each au- 
dience, he must determine the i>recise time at which 
the program should begin, and the times at which 
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various items of Inrormation should be presented. 

In planning the timing of dissemination activities, 
it is important to keep in mind the steps or phases 
which adopters usually pass through in the course 
of deciding whether to adopt or reject an Innova- 
tion/Comprehensive attention to each of these 
phases has been found to maximize the effectiveness 
of diffusion activities. 

The adoption process has generally been viewed 
as consisting of five phases: 

I . Amreness, or first knowledge of the existence 

of an Instructional material. 
2. fntemu or actively seeking further Information 

about the materia). 

i?va/wa//^rt, or forming a favorable or unfavor* 
able attitude toward the material. (This phase 
may be regarded as a subjective appralsa) of the 
material.) 

Trial of the malerial» on either a temporary or 
partial basis. This phase is an Informal valida* 
tlon testing by the consumer. 
Adoption (deciding to make futl use of the ma- 



3. 



5. 



terlal as the best course of actior 



rejection (deciding not to adopt he material). 



available), or 



It should be noted that these various phases may 
not always occur in the above sequence and, in some 
cases, one or two of them may seem to be skipped 
entirety. Nevertheless, extensive research indicates 
that the adoption of a new idea or product requires 
time and Involves distinct phases or steps. The dis* 
seminator, therefore, should attempt to keep'Mn 
phase** with his audience. In most cases, he should 
not neglect the initial phase of arousing the interest 
of and motivating the potential adopter prior to 
providing him with detailed information about the 
material. He perhaps should not push a "triaV* of 



the new product while the user is stilt seeking basic 
Information. And he should not continue to work 
on the lnterest*arouslng phase when the prospective 
user has already tried out the material and Is ready 
to adopt It. It) other words, It Is helpful for the dl$« 
semlnator to accurately appraise the phase of the 
change proems which the client has rea<;hed and 
design his messages accordingly. 

Selection of dliitmiiiaitoii media. In dissemlnat* 
ing a new product, d number of communication 
channels or media can be used. These include the 
periodicals aimi^ primarily at specialized audi* 
ences, such as The Jourml of Ttocher Education, 
or the Newslem cfihe Te(^ Division 
of CEC] conferences, m0«ings, and conventions of 
various kinds; direct mall access to members of 
selected 02gdni2atk>ns through their membership 
lists; and direct contact with practitioners. In some 
situations, mass media channels are effective for 
disseminating an Innovation; in other situations, 
interpersonal channels of communication may be 
more effective. 

The main advantage of mass media is that they 
can reach a targe number of persons rapidly^ They 
tend to be more effective at the awareness stage of 
adoption, and they are more effective for earlier 
t^an for later adopters. Their major disadvantages 
ar) that they are impersonal and that the recipients 
can expose themselves only to what they want to 
hear or see, easily shutting out or forgetting those 
messages with which they disagree. 

Ideas often seem to spread best and have the 
greatest Impact when people talk to one another, 
Thusjn addition to using the traditional kirids of 
communications medla> the disseminator should at- 
tempt to make maximum use of interpersonal com- 
munication channels that Involve face-to*face ex- 



172 



changes between two or more Individuals. 

In disseminating an Innovation, interpersonal 
channels tend to be especially effective at the evalu- 
ation and trial stages of adoption. Compared to 
mass media, interpersonal channels are much more 
capable of changing strongly held attitudes. It may 
be essential to use them when one encounters re- 
sistance Of apathy toward a new product. Other ad- 
vantages of Interpersonal communication are that 
it permits the communicator to select his own au* 
dience, detect inattention, correct misunderstand- 
ings, provide clarification, and obtain Immediate 
fe^back on the recipient's reactions. The main dis- 
advantage of the interpersonal approach is that it 
is relatively slow for reaching large numbers of 
people. 

The use of interpei-sonal channels can be greatly 
enhanced through the identification of opinion lead- 
ers-^those Individuals withiu the group who are 
more active than others in introducing new informa- 
tion into the communication network, and who exert 
a disproportionate amount of Influence on other 
group members. Such persons tend to rely for in- 
formation on sources external to their group; often 
they are more likely than other group members to 
attend conventions, travel, be in touch with out- 
siders, and have an interest in new information and 
ideas. Opinion leaders also tend to maintain a high 
level of social participation within their groups and 
often (although not always) are in a position of 
slightly higher status than those they influence. Por 
these reasons, opinion leaders can provide access 
to one's audience and its interpersonal communica- 
tion network^ and thus serve as valuable **links" 
between the disseminator and potential adopters. 



Dliseminatloii criteria 

The disseminator should try to evaluate the ef- 
fectiveness of his dissemination efforts. He should 
ascertain what action, if any, prospective adopters 
have taken, and he should plan ways of making 
further approaches to persons not yet *'sold*' on 
the innovation. 

Criteria for effective dissemination 

0 Clarity. Infof matiori should be clearly stated, 
wiih a particular audience in mind. 

□ Validity. 1 he Information should present a true 
picture. 

□ Pen asiveness. The information should reach all 
of the intended audience. 

□ Impact. The information should evoke the de- 
sired response from the intended audience. 

□ Timeliness. The information should be dis- 
seminated at the most opportune time. 

□ Practicaiiiy. The information should be pre- 
sented in the form besi suited to the scope of the 
project, considering such limitations as distance 
and available resources. 
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a. 0»mcn»tratlon 



A demonstration may be defined as an activity 
in which the participants observe planned, carefully 
presented examples of teat or simulated behavior 
illustrating certain techniques, materials, equip- 
ment, and procedures as they might realistically be 
employed (Harris, Bessent,& Mclntyre, 1969). 
The examples in this section are from demonstra- 
tions of materials at the inservice level, but the 
principles arc applicable to preserviCe training 
programs as welK 

Many experts regard demonstration as a very Im- 
portant part of the diffusion process. It has even 
been said that It is the most effective way of con- 
vincing educators of the value of a new product. In 
his well-known study of educational change in New 
York state, Brlckell (1961) asked hundreds of 
teachers and administrators what it took to persuade 
them to try an innovation that was being used in 
another schooL The consensus was that the bt^i way 
to judge an innovation was to see it in operatio:^ 
Brickelt concluded: 

Speeches, literature, research reports and con- 
versations with participants outside the actual 
instructional setting are interesting but relatively 
unconvincing. IMPLICATION: Recommended 
new programs must be demonstrated so that they 
can be observed in action (p* 27). 
Several types of demonstrations can be pre- 
sented in several kinds of contexts. A new product 
or set of materials can be demonstrated in a special 
"demonstration center'' set up specifically for that 
purpose. In some cases, a particular training pro- 
gram in which an innovation is being implemented 
can be designated as a '^demonstration school." In 
disseminating new curriculum materials, the Eastern 
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Regional Institute for Education (Mahan, 1970) 
made wide use of ''demonstration day*' programs. 
On such specified days, teachers from various 
schools were invited to spend (in entire day at a 
host school where the new materials were already 
in use. Within a single instltutlont ''demonstration 
lessons'* may be presented, that is, other trainers 
may be invited to observe the use of a new set of 
training materials. Demonstrations can ^so constt* 
tute an important part of inservice programs, such 
as workshops, institutes^ and conference. 

A demonstration can serve various purposes, It 
can be used to Inform observers of new materials 
and techniques, thus creating awareness; It can help 
to develop an understanding of the items being 
shown and explained; and it can help to arouse in- 
terest In the use of these items; Perhaps the most 
Important function Of a demonstratlcn> however, 
is to build conviction of the feasibility and usefi Iness 
of an innovation for the potential adopter. 

To accomplish these purposes effectively* a 
demonstration should meet the following criteria: 

Convenience, The demonstration should be con- 
ducted at a site within a reasonable distance of 
the Intended audience and should be easily 
accessible. 

Evidential assessment. The demonstration should 
provide an opportunity for potential adopters 
to examine and assess the operating qualities of 
the innovation. Accurate assessment Is possible 
only if the demonstration provides evidence that 
can be examined thoroughly, critically, and per- 
sonally. Moreover, the demonstration should 
illustrate both positive and negative factors re- 
lated to the innovation and its implementation so 
that an observer can reach a valid professlonai 
judgment on its utility for him (Clark & Cuba, 
1965). 



Credibility. The dcmortstratlon must be con- 
vincing and compelling. Consequently, It must 
be conducted in a situation that is very simitar 
to that in which tt would be used by the poten* 
tlal adopters. As Brtckell (1961 ) pointed out, 
anything abnormal, unreal, or artificial in the 
circumstances surrounding an observed program 
—that Is, anything apprccltsbly different from 
conditions in the visitors* oWn school system-— 
can rob the demonstration of its persuasive effect. 
Observers tend to be very sensitive to any dis- 
tinctive characteristics of the host school, such 
as the pupils' mental ability, financial support, 
physical facilities, teacher characteristics, and 
so forth, tf these characteristics are unlike those 
of his school, he will terid to 
parent success of the program to these differences. 

Planning a demonilration* As indicated, the lo- 
cation of the demonstration |s extremely Important; 
it should be selectcti to offer maximum convenience 
and credibility. In additlpn, if a school is to be the 
site of the demonstration, It should be selected on 
the basis of such factors as (ts leadership and 
policies toward experimentation, the attitude of the 
school board and the facilities available. 

Another important task Is to select a person (or 
persons) to conduct the demonstration. He must 
have considerable skill, knowledge, flexibility, in- 
terest, and enthilislasm. it has been found that dem- 
onstrattons by peers are more effective than demon- 
strations by high-status persons. Often it Is best to 
use teachers as the demonstf ators, especially if 
curriculum materials and students are Involved, and 
if the observers themselves are teachers. The ar- 
rangements for the demonstrations can, of course, 
be made by j^/crsons other than the developer* 

In selecting participants for the demonstration, 



attention should be given to the optimum group 
size, The problem of having too many persons in 
attendance must be weighed against the disadvan<» 
tages of having too few. The optimum size of the 
group depends, in part, upon the size of the objects 
and movements to be demonstrated. Thus, some* 
times 5 or 10 persons will be enough but sometimes 
40 or 50 will be desirable. 

Do not Invite "Just anyone". Select persons who 
cart and will profit frorh the demonstration. They 
can be chosen on the basis of interests and expressed 
or diagnosed need. Sometimes it is advisable to in* 
elude high^statUs persons who can provide follow-up 
support after the demonstration, 

Attention should be devoted to preparing an ef- 
fective letter of Invitation which should be mailed 
out with the registration forms. If possible, send 
out in advancea descriptive article or brochure or 
other Orlentattpn materials that provide background 
information about the innovation to be demonstrated. 

Prepare a detailed plan of the demonstration it^ 
self, following these preparatory steps, 

1. Outline the sequence of events in detail, 

2. Review and revise the outline. 

3. Prepare the materials and equipment that will 
be needed before and after the demonstration 
and during each event, including such resources 
as space, facilities, and personnel. 

4. Stage a ''dry run" of the demonstration before a 
few persons who can suggest refinements. 

5. Prepare a final revision of the demonstration 
plan according to a carefully develop^ time 
schedule and incorporate it In a printed program 
or agenda* 

FoUowmp activttiei. Follow-up activities are 
often planned for immediately after the demonstra- 



tlon NVbite impressions are still vivid and interest 
is high. Possible follow-up activities include Ithe 
following: ] 

\ 

Ohcussion of techniques, procedures, and ma- 
leriais observed* It Is usually best to provide 
for the answering of questions, as well as dis< 
cussion, explanations, and analysis, qfter the 
demonstratioh rather than during it. This recom- 
mendation Is especially true if explanatory com- 
ments during the demonstration would detract 
from th^ realism of the situation. 
Laboratory Sesslorts, In which the observers, 
sometimes In a group, attempt to do what they 
have seen demonstrated. 
Directed pr^ilce sessions, In which the Indi- 
vidual observer is guided in his efforts to do what 
has been demonstrated. 

Interviews with observers to plan ways of using 
demonstrated procedures or techniques In a real 
situation. 

Several kinds of follow-up activities also may be 
desirable after the observers have returned to their 
home schools. One of the most valuable steps is to 
provide them with assistance to implement the ob- 
served procedures. This type of follow-up support 
would undoubtedly do much to increase the effec- 
tiveness of the demonstration as a diffusion method. 

Evaluation' A final but important task is to 
evaluate the participants' reactions, both at the 
time of the demonstration and later, sometime 
after they have returned to their school situa- 
tions. Often, a simple evaluation instrument is 
prepared for participants to fill out at the end 
of the demonstration program. An even more 
important evaluation task is to determine the 



extent to which the Innovation has actually been 
adopted as a result of the demonstration. Data 
relevant to this question can be obtattted through 
follow*up letters, telephone calls, personal visits 
to school district offices, examination of \ti- 
service workshop rosters, arid, In somi cases, 
regional salesmen or distributors of the new ma- 
terlals. Another type of foHow*up activity that 
may prove profitable Is to arrange some form of 
Interaction with potentially interested persons 
who were invited but unable to attend the dem- 
onstratlon* 



Guidelines for maxtitilzing the effectiveness 
of ademonslratlon. 

□ Offer the observers something new or different 
or» at least, more highly refined than that with 
which they are already famUtar. 

□ Encourage team attendance, if possible. Try to 
have several persons from the same university or 
school district attend the demonstration, instead 
of just one from each institution; 

□ Design the demonstration to make maximuni use 
of viewing; use listening as a supporting element. 

□ Arrange in advance for adequate facilities, wv 
eluding good lighting and acoustics, sitting or 
standing room for good viewing, a physical set- 
ting that can be staged to approximate reality, 
and microphones that can be suspended over thu 
demonstration area, 

□ Design an observation instrument to encourage 
note-taking. 

□ Introduce the demonstration briefly; give needed 
information for meaningful observation; tell (he 
audience why it is observing, what to look for, 
and how to observe. 
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□ Arrange for newspaper or (ctevision publicUy. 

□ Use persons other than the dcmonslralor for 
follow-up activities to avoid the problems of 
fatigue, emotional Involvement, and role shift. 
Follow-up leaders shouki be selected, trained, 
and briefed in advance. 

□ Arrange for coffee or other refreshments at the 
beginning of the meeting; where possible, make 
allowances for smokers. 

□ Permit and encourage free verbal interchange 
with classroom (eachers who have used the in- 
novation. 

□ Avoid formal presentations by outside experts 
and too much participation by representatives 
of educational change agencies. 

With regard to the last two points, the Eastern 
Regional Institute for Education (ERIE), in its 
publication entitled How to plan a curriculum dem- 
onstradon day (Mahan, 1970), reported that feed- 
back from evaluation questionnaires, completed by 
demonstration day visitors, 
* . . tended to underscore the impact of observa- 
tion of classroom teaching and free verba) Inter- 
change with classroom teachers They did not 

come to be lectured at or to discuss theoretical 
frameworks for educational change They came 
to see and to get the facts from teachers for whom 
the new curriculum was an everyday classroom 
reality (p. 25). 

In addition^ the Bl^lE demonstration day pro- 
grams provided the opportunity to questfo i the 
pupils who were observed and witness the adminis- 
tration of a competency measure. Plenty of time 
was available lo question the principal about such 
aspei:t$ of the program as time considerations, 
costs, relation to the total curriculum, inservice 
training tequirements, and so forth. Also ^heduled 
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wCrc give-and-take sessions among visitors, princi- 
pals, and several teachers, and a well-written 
summary article about the Innovation was distributed 
to be taken home. 

Advantages and disadvantages of demonstrations* 

The demonstration has a number of advantages as 
a type of diffusion activity, A primary one is that it 
permits observation and provides an opportunity to 
evaluate the innovation before it Is tried out. Also, 
the demonstration is a highly visible and publicizable 
technique; it stimulates activity and involvement on 
the part of potential users; and it reinforces the 
adoption behavior of the demonstrator himself (if 
he is a user) through the public commitment he 
makes by demonstrating the innovation, 

Demonstration has some limitations, however. 
Although the demonstration may be useful to de- 
velop knowledge, understanding, interest, and per- 
haps even conviction, it is not feasible for the de- 
velopment of actual skills as usually the audience 
merely observes. Another limitation is that only a 
relatively small number of persons can be influenced 
through a demonstration because the size of the au- 
dience must be limited. Also, demonstrators may 
overemphasize the success of the innovation and 
play down the difficulties and possible failures. 
Finally, a demonstration that fails may have a very 
negative effect on a change effort. Nevertheless, as 
Havetock (1969) pointed out, if the failure is due to 
the complexity and real difficulties inherent in the 
innovation itself, rather than to the sponw's failure 
to plan and carry out the demonstration effectively, 
actual benefits may accrue. 
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3. Facllitatino adoption 



Guidelines for overcoming resistance to change^ 



In addition to disseminating and demonstrating 
a new instructional product, sometimes the dlffuser 
also has the responsibility of helping the adopter to 
put it into practice or install it. This responsibility 
Involves two mj\Jor Icinds of objectives: (a) **opera- 
tlonalizing*' the innovation^ that is, adapting it to 
the specific conditions and needs of the adopting 
Insiitutlon; and (b) ''Institutionalizing*' it, that is, 
eslat>li$hing it as an integral part of the ongoing 
program, This section is concerned mainly with the 
tatter objective. 

Gaining acceptance and support 

The diffuser can facilitate adoption in a variety 
of ways, In preparing for the Initial use of an in- 
novation within a particular system, it is helpful 
first to get the support of key administrators and 
staff members. An attempt should then be made to 
identify other persons who are favorably disposed 
toward the innovation. Most experts agree that 
initially it is usually best to work with those parts 
of the system that desire to change. 

Attention should also be given, however, to win- 
ning over important individuals who are opposed 
to the innovation. In dealing with opponents, it may 
be desirable to (a) include them, if possible; (b) 
make their participation voluntary, if possible; 
(c) if they say it's nothing new, get them to help 
others; (d) attempt to alleviate their fears about the 
innovation; and (e) consider alternative forms of the 
innovation which they might accept. Watson (1969) 
proposed the following list of guidelines for over- 
coming resistance to change: 



Who Brings the Change? 

1. Resistance will be less if administrators, teachers, 
Board members and community leaders feel that 
the project is their own— not one devised and 
operated by outsiders. 

2. Resistance will be less if the project clearly has 
wholehearted support from top officials of the 
system. 

What Kind of Change 

3. Resistance will be less if participants see the 
change as reducing rather than increasing their 
present burdens. 

4. Resistance will be less if the project accords with 
values and ideals which have long been ac- 
knowledged by participants. 

5. Resistance wilt be less if the program offers the 
kind of new experience which interests parti- 
cipants. 

6. Resistance will be less if participants feel that 
their autonomy and their security is not 
threatened. 

Procedures in Insliluting Change 

7. Resistance will be less if participants have 
joined in diagnostic efforts leading them to agree 
on what the basic problem is and to feel its 
importance. 

8. Resistance will be less if the project is adopted 
by consensual group decision. 



'Watson. Goodwin, '^Reslsisnce to Change." In W. 0. 
Bennis. et at, The Planning of Change. N. Y.: HoH, 
Rfneharl & Winston, Inc., 1d69, p. 487, 



9. Resistance wilt be reduced if proponents arc 
able to empathize with opponents; lo recog- 
nize valid objections; and lo lake steps to relieve 
unnecessary fears* 

10. Resistance will be reduced if it is recognized 
that Innovations are likely to be misunderstood 
and misinterpreted, and if provision is made 
for feedback of perceptions of the project and 
for further clarification as needed. 

1 h Resistance will be reduced if participants ex- 
perience acceptance, support, trust, and con- 
fidence in their relations with one another. 

12. Resistance will be reduced if the project is kept 
open to revision and reconsideration if experi- 
ence indicates that change would be desirable. 

Planning for Implementation 

In addition to gaining as wide acceptance of the 
innovation as possible, It is advisable to draw up a * 
detailed plan for implementing the innovation. The 
implementation plan might consider such questions 
as the following: 

\. Sources of funds for installing and maintaining 
the innovation. 

2. Provision of the necessary facilities, equipment, 
and materials. 

3. The gaining of community support, when needed. 

4. The feasibility of a small-scale trial of the in- 
novation involving a limited number of per* 
sonnel ?uid resources. 

5. Provision of external consultants and other 
outside resources. 

6. Structural and procedural changes in the sys- 
tem that may be required for the innovation to 



succeed (e.g., grading practices, class compo- 
sition, time allocation). 

7. Procedures for continuing evaluation and feed- 
back on the Innovation. 

8. Assignment of specific responsibilities for im- 
plementation. 

9. Released time or reduced teaching loads for 
persons directly Involved with the Innovation. 

10. Providing supportive assistance and encourage- 
ment to those undertaking the new program 
(e.g.» through praise, recognition, and other 
rewards). 

Involving Staff Members 

Whenever possible^ all persons who will be af- 
fected by the Innovation should participate In the 
planning. Research has shown that, in most cases, 
involving the entire staff In implementing an inno- 
vation greatly increases the likelihood that it will 
be accepted. 

The diffuser should be aware of the variety of 
techniques that are available for group discussion 
and interaction. Some of these techniques are es- 
pecially useful for conveying information, others 
for arousing interest, and others for arriving at a 
group decision. An excellent description of ihese 
different methods, including their uses, advantages, 
and dangers, as well as a step-by-step account of 
how to implement each, is given in Leadership and 
Dynamic Group Action (Seals, 1962). The methods 
covered in depth by Beals include large group dis- 
cussions, the huddle method, *'buz2** groups, panel 
discussions, interrogator panels, committee hear- 
ings, and role-playing. 
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Workshops and Inservlce Activities 

The use of workshops and Inservice training is a 
diffusion technique of great importance. Many new 
kinds of instructional approaches, techniques, and 
materials require special skills which teachers do 
not obtain in the course of their regular training. 
The lack of the required training and skills is fre- 
quently the cause of the failure or discontinuance 
of an innovation that previously had been adopted, 
sometimes with initial enthusiasm, by teachers. Since 
a number of useful publications are available that 
deal with inservice education, this section provides 
only a very brief overview of some of the major 
factors to be considered in utili:^ing workshops as a 
diffusion technique. 

The first step in planning a workshop or other 
training prugram is to formulate one's objeclives 
and then to decide on a suitable means (i.e., activl* 
ties) to achieVe them. The term *'objective" implies 
that the program should have some predetermined 
result that may be expressed in terms of people's 
behavior. Harris et al. (1 969} have classified the 
objectives or outcomes of inservice programs into 
the following types: knowledge, comprehension, 
application, synthesis, values and attitudes, and ad< 
justment. A variety of activities are possible, in- 
cluding lectures, demonstrations, observation, in* 
terviewing, brainstorming, group discussions, buzz 
sessions, role*playing, and guided practice (playing 
the role in a real situation). 

The choice of a workshop director is very im- 
portant; the success of the program depends in large 
measure on his leadership, organizational ability, 
and innovativeness. A carefully developed plan is 
desirable, but it should be sufficiently flexible so 
that it can be modiHed in accordance with unanti- 
cipated problems and the wishes of the participants. 



In planning an inservice program, as in the case 
of demonstrations, careful attention must be given 
to the provision of adequate facilities. For example, 
if the participants are to be divided Into teams, each 
team should have a separate room where it can meet 
undisturbed. If possible, these rooms should be 
close enough to facilitate intergroup communica* 
tion. It is often desirable to have another room near* 
by for typewriters, duplicating e<fuipnient, audio* 
visual equipment, and other aids. Audio and video 
tape recorders are usefiJl to provide a permanent 
record of the program, resolve disagreements, and 
encourage self-analysis. 

Attention must also be given to ensuring an au- 
dience of the desired size and composition. Incen- 
tives should be provided for attendance, such as 
emphasizing the program's usefulness to the parti- 
cipants, arranging for university credit, or providing 
stipends or reimbursement of tuition fees. Good 
publicity is often needed to attract the desired 
participants. 

Remember that most teachers value the oppor- 
tunity to acquire practical skills more than theo* 
retical discussions. A continuing program of In* 
service training, with regularly scheduled sessions 
throughout the school year, may be much more ef- 
fective than a single, one-shot effort. It is highly 
desirable, where possible, to arrange for teachers 
to get released time rather than extending the length 
of their working day by conducting inservice pro- 
grams after school hours. In cases where workshops 
are to be conducted during the summer, planning 
for them should be started In November or December 
of the previous year to allow time for the necessary 
budgetary allocations, selection of a good director, 
and mailing preliminary information before teachers 
make other plans. 

The diffuser should not view inservice training as 
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an Isolated technique for bringing about the adop- 
tion of an innovation. Instead, he should consider 
all the organizational factors that need to be adjusted 
to give the proposed change a supportive environ- 
ment (organizational rules or procedures such as 
grading practices, staffing patterns, grouping, re* 
sources, departmentalization, etc.). He should iden- 
tify in advance all changes of this type that are re- 
quired to meet the objectives of the inservice 
program. 

For a detailed coverage of all of the many things 
to be considered in conducting an inservice pro- 
gram, the reader is referred to a publicotion of the 
Eastern Regional Institute for Education (ERIE), 
entitled How to conduct a workshop . . . (Riiz & 
Wallace, 1970), This report, which is now out 
of print, can be obtained through the ERIC system. 
It includes detailed flowcharts covering each of the 
following aspects of conducting a workshop: in- 
structional program, funding and costs, staffing, 
materials, scheduling, site logistics, publicity and 
registration, college credit procedure, noninstruc- 
tional activities, and evaluation. 
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specific definitions in this glossary relate to the 
development of Instructional materials for teacher 
training In special education. The terms In other 
contexts may have broader applications. 

adJuiKl programing A mastery-learning format 
that provides the trainee with a test on the content 
of some specified material (e.g., a chapter of the 
textbook) and a self-scoring device (e.g., punch* 
board). The trainee self scores the test and selec 
tlvely restudies areas missed. 

appropriateness Appropriateness of an instruc* 
tional material Is the extent to which its objectives 
and content are consonant with goals of teacher 
training In special education as judged by experts. 

audlotutorlal modules A self-instructional multi- 
media format that uses audiotape recordings as the 
integrating element. The trainee performs all ac« 
tivities suggested by the tape to attain the instruc- 
tional objectives. 

behavioral objectives Specification of the pur- 
poses of Instruction In terms of desired terminal 
performance of the trainee. Behavioral objectives 
also specify the conditions under which this per- 
formance is to take place and the criteria for mini- 
mum acceptable performance. 

branching programs The second most common 
type of programed instruction that checks the mas- 
tery of content through frequent use of multiple- 
choice questions, Depending upon the trainee's 
choice, he is referred to the next main frame or a 
remedial-Instruction frame. Thus the sequence of 
frames varies from person to person depending 
upon performance. 
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eomputor*ai«lit«d r*m«dl«l •dueatton {c$t$) A 

computer-based (ndtructional format, developed at 
the Pennsylvania State University, which Is pro* 
gramed to present Information both visually and 
audltorldlly and to accept trainee's responses 
through a typewriter keyboard or light pen. 

eomputer-astlited repeated (eating (cart) A com- 
puter-based Instructional format In which various 
equivalent versions of the cilterlon test and answer 
key are generated by a computer and used In a 
mastery-learnlng situation. 

computer-aiiltled teacher training ayttem (oatta) 

A computer-based format in which a trainee's 
teaching performance Is coded on any siandard 
observation system by trained observers and tn<> 
stantaneousty processed and fed back to the trainee 
by a computer. 

concept analyalt A systematic procedure for the 
Identification of major concepts to be taught to 
trainees, the interrelation of those concepts, and 
the critical and irrelevant attributes of each concept. 

criterion-referenced tettt A test designed to di- 
rectly measure the trainee's attainment of specific 
instructional objectives. The trainee's performance 
in criterion-referenced tests is compared with 
standards specified by the objectives and not with 
the performance of others. 

developmental tatting A component of formative 
evaluation in which the instructional material Is 
tried out with representative trainees to obtain 
feedback for the Improvement of the materials. 

diffusion The procedures for dissemination and 
distribution of completed Instructional materials to 
users. The diffusion process also Inbludes measures 
to assure that materials are adopted and used in 
training programs. 



effectlvenesi Effectiveness of an instructional 
material Is the extent to which Instructional objec* 
tives are attained Iralnees who work through the 
material. 

antry level or behavior The level of relevant be* 
havtor at the beginning of instruction. 

entry queettonnalre A questionnaire administered 
prior to instruction to collect relevant educational 
and experiential data. 

entry test A criterion-referenced test which Is 
based upon the specification of prerequisite skills 
and knowledge. Entry tests determine if a trainee 
Is ready to benefit from Instruction. 

evaluation design An expertmenlai or quasi- 
experimental design for measuring the effective- 
ness and validity of an instructional material. 

expert appralMi The process of obtaining expert 
opinion on technical and conceptual qualities of 
the instructional material from editors, sub)ect« 
matter experts, and media producers. This Infor- 
mation may be used formatlvely to Improve the 
material or summatlveiy to certify Its quality. 

feasibility Feasibility of an Instructional material 
Is the extent to which it Is usable In teacher-training 
programs in special education. 

field training A resource-management format that 
provides the trainee with behavioral objectives and 
references to Instructional and human resources. 

formative evaluation Evaluation of instructional 
materials and methods tp collect useful information 
for improving their effectiveness. 
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formal Mlactlon A systematic procedure for 
choosing an approprlale Instructional format on 
(he basis of (earner characteristics, requirements 
of Ihe Instructional task, and dissemination factors. 

front omt analysis A systematic procedure for 
analyzing the underlying problems In a given field 
in terms of the discrepancy between the desired 
criterion and actual performance and for suggesting 
possible alternative strategies. 

Information mapping A self*lnstructlonal print for- 
mat in which units of instructional content are pre* 
sented in one of seven standard layout formats 
depending upon the type of learning Involved; con- 
cepts, structures, processes, procedures, classifi- 
cation, facts, and proofs. 

input measures Tests and instruments for the 
measurement of aptitudes, characteristics and entry 
behaviors of trainees prior to instruction. 

tnatructlonal game A small group Instructional 
format that involves competition between players 
(or teams) to reach a prespecified criterion through 
a series of moves which are controlled by rules 
of play. 

Instructional systems technology An applied sci- 
ence based on research on learning and communi- 
cation that deals with the design, development, 
and evaluation of systems of materials and man- 
agement strategies employing human and non- 
human resources for the efficient attainment of 
specific learning objectives, 



tntarnal validation One phase of validation test- 
ing for determining the extent to which an Instruc- 
tional material teaches what it Is supposed to teach. 
It usually requires the administration of a posttest 
Immediately after a group of trainees complete the 
Instructional material and the measurement of 
their attainment of the instructional objectives. 

learner analysis A systematic procedure for iden- 
tifying those characteristics of Ihe target population 
which are relevant to the design of instruction. 

linear programs A type of programed Instructional 
material that presents the instructional content In 
a fixed sequence. Traditional linear programs make 
extensive use of small steps, prompting and con- 
structed response questions, and revlss the material 
until a low error rate is achieved. Current linear 
programs tend to be lean with large frames and 
low rate of redundancy. 

mastery-learning formats instructional formats that 
permit ^ nd encourage the trainee to take the unit 
critorioh tests repeatedly and provide him with 
formative feedback for remedial instruction. 

media Any means for recording, storing, and dis- 
tributing information. The term is used inlerchange- 
ably to refer to materials (software), such as film 
or audiotape, and equipment (hardware], such as 
film projector or tape recorder. 

media attributes Characteristics Or capabilities of 
different media, such as the ability to show objects 
In motion, to present auditory and visual stimuli, 
and to permit random access. 
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media salectlon A systematic procedure for 
choosing appropriate medium (or media) on the 
basis of learner characteristics, requirements of 
the Instructional objectives and dissemination 
factors. 

mlnicourtet A multimedia training format based 
on the micio-teachlng technique. The rrethod re- 
quires model films or videotapes, peer or classroom 
teach Ing by trainees, self evaluation of the video- 
taped performance, and reteachlng. 

ob|«ctiv#t outline A resource-management format 
that provides the trainee with a set of hierarchically 
arranged behavioral objectives and entrusts him 
with responsibility for attaining them. 

output measures Tests and instruments for col- 
lecting data on trainees' behaviors and attitudes as 
a result of completing an Instructional material. 

p9/islng The rate at which infcrmatlon is presented 
to the learner. Self-pacing indicates that the learner 
can control this pace (e.g., a printed book). Equip- 
ment pacing Indicates that this rate Is determined 
solely by the speech of the machine (e.g., a 
recorder replaying tape at the rale of 7V2 Inches 
per second). 

paper*and-pencll test A test that measures the 
tralnee^s attainment of instructional objectives 
through printed questions which require choices or 
written responses. 

payoff validation The final phase of validation 
testing In which the effects of newly acquired skills 
and knowledge are measured. For example, 
changes in children's reading behavior may bo 
measured in order to validate some new teaching 
skills. 



performance test A test that requires the trainee 
to demonstrate hts attainment of an Instructional 
objective through the actual performance of a task 
rather than a verbal description. 

personalised aystem of Instruction A mastery- 
learning format that requires th^ trainee to dem- 
onstrate mastery of one unit before moving on to 
the next. This format usually uses advanced trainees 
as test proctors and tutors. 

postteet A criterion-referenced test that is ad- 
ministered after Instruction to determine whether 
the trainee has attained the objectives ol the in- 
structional material. 

pretest A criterion-referenced test that Is admin- 
istered prior to the beginning of Instruction to de- 
termine the extent to which the trainee has already 
attained the objectives of the instructional material. 

process measures Tests and instruments for col- 
lecting data on trainees' behaviors and attitudes 
as they work through an instructional material. 

professional lurylng The process of collecting 
and reporting expert opinion In order to decide 
whether an instructional material is ready for dis- 
semination. The same information also provides 
potential users with objective appraisals. 

protocols Records of real or reatlatic instructional 
behaviors designed to exemplify ^/ducatlonally 
relevant concepts. 

programed Instruction Currently defined as any 
piece of validated Instructional material. Common 
usage of the term refers to a self-lnstructi*)nal print 
format that presents information in frames, requires 
the trainee to use the Information in resf^ndlng to 
a question, and presents Immediate feedback on 
the correctness of the response. 
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riiKlom icctM Degree (o which the medium per- 
mH$ the trainee to go direoUy to any specific part 
of at) Instructional presentation. The random access 
of printed materials Is high, that of films Is low. 

rating icale An observation Instrument that en- 
ables a Judge to Inspect the performance of a 
trainee or the product of such performance and to 
rate It objectively along a number of specified 
dimensions. 

repealed letting A mastery-ledrntng format with 
alternative instructional resources keyed to be- 
havioral objectives. The trainee takes parallel ver- 
sions of unit criterion tests which are evaluated by 
the instructor and returned with suggestions for 
remedial Instruction. This procedure is repeated 
until satisfactory performance Is obtained. 

reeourte-management formats Instructional 
formats that provide directlonp. for using existing 
textual, mediatedi and human resources. 

reiource-tl$t A resource-management format that 
provides the trainee with a set of behavioral ob- 
jectives coded to various instructional materials. 
The trainee's mastery of these objectives is tested 
with appropriate criterion tests. 

roleplay A small group instructional format in 
which the teacher trainees act out specific roles 
from an educationally relevant Interpersonal 
situation. 

fcrlpted protocols Protocols produced by record- 
ing a scripted dramatization of Instructional events 
to exemplify selected educational concepts. I 

'1 



leniory mode The sense through which the learn* 
er receives Information. Auditory and visual modes 
are the predominant ones through which Instruc- 
tional information Is usually presented. 

sign type The relation between signs and sym* 
bols and the objects they represent. Verba/ presen* 
tations use arbitrary signs (e.g.. letters and num- 
erals) while nonverbal presentations (e.g.. pictures 
and photographs) use signs that resemble what 
they represent. 

simulations An instructional format that Involves 
a hypothetical representation of an educationally 
relevant situation. Various aspects of reality are 
differentially emphasized depending upon their 
relevance to the instructional objectives of the ' 
material. 

iummatlve evaluation Evaluation of instructional 
materials under specified conditions In order to 
measure and report their effectiveness. 

target trainee or target population The group of 
learners for whom an instructional material Is de- 
signed. 

task analysis A systematc procedure for the spe- 
cification of the main task to be performed by the 
trainee upon the completion of instruction. Its 
analysis into subtasks. and their arrangement into 
learning hierarchies. 

total-package testing Final stage of developmental 
testing in which the instructional material is tried 
out in actual training situations outside the super- 
vision or control of the developer. 

training material Instructional materials designed 
to help trainees acquire specific performance 
skills related to teaching. 



traniler valldntlon One phase of validation testing 
during which the extent of change In a trainee's 
performance as a result of his newly acquired 
Knowledge and skills Is determined. For example, 
the actual classroom teaching by the trainee may 
be systematically observed to measure his appIN 
cations of various teaching skills. 

validation tasting Testing of the final version of 
the instructional material In order to demonstrate 
ard document its effectiveness. 
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